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Bayesian  and  empirical  Bayesian  methods  have  become  quite  popular  in  the 
theory  and  practice  of  statistics  in  the  last  two  decades.  In  particular,  hierarchical 
and  empirical  Bayesian  methods  are  very  suitable  in  the  context  of  simultaneous 
estimation  when  there  is  a genuine  need  for  “borrowing  strength.” 

Often,  however,  the  goal  is  not  just  to  produce  an  ensemble  of  estimates 
simultaneously  for  several  parameters  but  also  to  produce  a set  of  estimates 
whose  empirical  histogram  estimates  well  the  histogram  of  population  parame- 
ters. However,  in  a general  framework,  the  histogram  of  the  posterior  means  of 
coordinate-specific  parameters  is  underdispersed  as  an  estimate  of  the  histogram 
of  parameters.  This  requires  adjustment  of  Bayes  and  empirical  Bayes  estimators. 
One  way  to  meet  the  twin  objectives  as  mentioned  earlier  is  to  match  the  first  two 
empirical  moments  of  the  Bayes  estimates  with  the  posterior  means  of  the  mean 
and  variance  of  the  population  parameters.  The  resulting  estimators  are  referred  to 
as  constrained  Bayes  estimators. 

It  is  also  known  that  least  squares  estimators  reflect  goodness  of  fit  consid- 
eration, while  quadratic  losses  reflect  solely  precision  of  estimation.  Thus  there 
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is  a need  to  provide  a framework  within  the  tradeoff  between  goodness  of  fit  and 
precision  of  estimation.  With  a consideration  of  this  need,  balanced  loss  functions 
are  introduced  which  reflect  two  criteria-goodness  of  fit  and  precision  of  estimation. 

This  dissertation  focuses  on  constrained  Bayes  and  empirical  Bayes  estimators 
with  asymptotic  measures  of  precision  associated  with  these  estimators.  We 
consider  both  the  squared  error  loss  and  the  balanced  loss.  Estimators  are  derived 
under  several  situations,  such  as  the  one-parameter  exponential  family  with 
conjugate  priors,  with  particular  emphasis  on  the  normal-normal  case,  and  the 
balanced  random  effects  normal  ANOVA  model.  Also  asymptotic  measures  of 
precision  associated  these  estimators  are  derived  which  are  valid  up  to  a specified 
order  of  approximation. 
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CHAPTER  1 
INTRODUCTION 

One  of  the  main  objectives  of  this  dissertation  is  to  obtain  the  asymptotic 
mean  squared  errors  (MSE’s)  of  constrained  Bayes  and  empirical  Bayes  estimators 
which  are  correct  up  to  a certain  order,  and  obtain  estimates  of  these  MSE’s  which 
are  asymptotically  unbiased.  In  addition,  constrained  Bayes  and  empirical  Bayes 
estimators  are  found  under  balanced  loss  functions.  Their  asymptotic  Bayes  risks 
are  calculated,  and  asymptotically  unbiased  estimators  of  these  Bayes  risks  are 
obtained. 

1.1  Literature  Review 

Bayesian  techniques  are  widely  used  for  simultaneous  estimation  of  several 
parameters  in  compound  decision  problems.  A well-known  example  is  small 
area  estimation  where  interest  lies  in  simultaneous  estimation  of  means  or  other 
parameters  of  interest,  say,  for  counties,  census  tracks  or  other  local  areas.  Under 
any  quadratic  loss,  the  Bayes  estimates  turn  out  to  be  the  posterior  means  of  the 
parameters  of  interest. 

Often,  however,  the  objective  is  not  only  to  produce  an  ensemble  of  parameter 
estimates  under  a certain  loss,  but  also  to  ensure  that  the  histogram  of  the 
estimates  is  somewhat  close  to  the  histogram  of  the  population  parameters.  For 
example,  if  Xi\0i  are  independent  N(9i,  1)  and  9i  are  iid  N(^,  A ),  (i  = 1,  2, ...,  m), 
then  assuming  squared  error  loss,  the  Bayes  estimator  of  6 — (9\, ...,  9m)T  is  the 
posterior  mean  ((1  — B)X i + B '/z,  ...(1  — B)Xm  + B/j,)t  = (1  — B)X  + Bfi lm, 
where  B — (1  + A)-1,  X — (Xi,  ...,Xm)T  and  lm  is  an  m-component  column 
vector  with  each  element  equal  to  1.  On  the  other  hand,  the  optimal  Bayes 
estimator  of  the  population  histogram  of  parameters,  namely,  YJiLi  hox<t) 
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(7  being  the  usual  indicator  function)  is  given  by  m_1  x P{&i  < t\Xi ) = 
m_1  Eili  4>[{f  - ((1  — B)Xi  — B/i)} /{l  - B)1/2]  where  $ is  the  distribution  function 
of  the  iV(0, 1)  variable,  since  9i\Xi  are  independent  77((1  — B)Xi  + Bn,  1 — B). 

As  pointed  out  by  Louis  (1984),  who  examined  an  example  from  hypertension 
detection  and  follow-up  study,  this  is  the  situation  in  subgroup  analysis,  where  the 
problem  is  not  only  to  estimate  the  different  components  of  a parameter  vector,  but 
also  to  identify  the  parameters  above  and  other  parameters  below  a specified  cutoff 
point.  More  generally,  one  may  be  interested  in  classifying  the  parameters  into 
several  categories.  Spjotvell  and  Thomsen  (1987)  documented  that  it  is  possible 
to  adopt  a modified  Bayesian  procedure  to  improve  on  the  posterior  means  as 
estimates  of  proportions. 

The  twin  objectives  mentioned  in  the  previous  paragraph  are  usually  conflict- 
ing in  the  sense  that  one  is  often  achieved  at  the  expense  of  the  other. 

The  posterior  means  of  the  parameters  of  interest  are  the  optimal  estimates 
under  any  quadratic  loss.  However,  it  can  be  shown  in  a general  framework 
that  the  histogram  of  the  posterior  means  of  coordinate-specific  parameters  is 
underdispersed  as  an  estimate  of  the  histogram  of  parameters.  Accordingly,  the 
histogram  of  posterior  means  is  clearly  inappropriate  to  estimate  the  parameter 
histogram.  Indeed,  no  single  set  of  estimates  can  simultaneously  optimize  the  two 
goals  as  mentioned  in  the  previous  paragraph.  However,  in  many  policy  settings, 
communication  and  credibility  are  enhanced  by  reporting  a single  set  of  estimates 
with  good  performance  for  both  the  goals.  Thus,  there  is  a need  to  find  a set  of 
estimates  which  is  suboptimal  according  to  each  one  of  the  two  criteria,  but  serves 
as  a very  useful  compromise  between  the  two. 

To  this  end,  Louis  (1984)  proposed  a constrained  Bayes  method  which  matches 
the  first  two  empirical  moments  of  the  Bayes  estimates  of  the  normal  means  with 
the  corresponding  moments  derived  from  the  posterior  histogram,  and  minimizes 
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the  squared  distance  of  the  parameters  and  estimates  subject  to  these  constraints. 
Ghosh  (1992)  generalized  Louis’s  findings  to  obtain  results  for  any  arbitrary 
distribution,  not  necessarily  normal.  The  resulting  estimates  are  referred  to  as 
constrained  Bayes  (CB)  estimators. 

Ghosh  (1992)  derived  such  estimators  for  the  one-parameter  natural  exponen- 
tial family  of  distributions  with  quadratic  variance  functions  (NEF-QVF)  when 
the  parameters  of  interest  were  the  population  means.  Also,  empirical  Bayes  (EB) 
analogues  of  the  CB  estimators,  referred  to  as  CEB  estimators,  were  developed  in 
the  normal  case,  and  these  estimators  were  analogues  of  the  celebrated  James-Stein 
estimators. 

Consider  the  situation  where  the  data  are  denoted  by  x and  9 — (Qi, ...,  9m)T 
is  the  parameter  of  interest.  Let  eB(x ) = (ef  (x), ...,  eB(x))T  denote  the  Bayes 
estimate  of  9 under  any  quadratic  loss  based  on  data  x.  Our  objective  is  to  find 
the  Constrained  Bayes  (CB)  estimate  eCB(x)  = (efB(x), ...,  e£B(x))T  of  0,  where 
eCB(x)  minimizes 

m 

(1-1) 

i=l 

within  the  class  of  all  estimates  t(x)  — t = (ti,  ...tm)T  of  6 that  satisfy 

m 

(a)  E{9 |x)  = m~l^ti(x)  = f(x),  {say)  (1.2) 

t=l 

m m 

{b)  E\Yj{9i  - 9)2 |x]  = £[*(*)  - f(x)]2.  (1.3) 

t=l  i=l 

It  is  easy  to  see  that  the  estimate  eB(x)  of  9 satisfies  (1.2)  . However,  it  does 
not  satisfy  (1.3).  To  see  this  we  define  Im  as  the  identity  matrix  of  order  m,  lm  as 
the  m-component  column  vector  with  each  element  equal  to  1,  Jm  = lml^,  and 


calculate 
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E\Z(Ot-S)*\X] 

i= 1 


tr[(im  - -jm)E(eeT\x)) 

m 

tr[(Im  - -Jm){V(9\X)  + £(0|X)£(0|X)t]} 
m 

1 m 

tr[{Im  - -Jm)V(0\X)]  + £(ef  (X)  - eB(X))2 

m <=i 

m 

tr[V(0  - eim\X)\  + Z(ef(X)  - eB(X))2 


m 

> $ >f(X)-efi(X ))2. 

<=i 

The  above  points  out  very  clearly  the  limitations  of  usual  Bayes  estimates  in 
estimating  the  true  variation  among  the  0j’s. 

However,  it  is  possible  to  find  a vector  of  estimates  6 which  minimizes  (1.1) 
subject  to  (1.2)  and  (1.3).  A theorem  to  this  effect  is  proved  in  Ghosh  (1992).  For 
stating  this  theorem,  we  need  a few  notations.  Let 


Hi(x)  = tr[V (9  - 9lm\x)]  = tr[(Im  - m 1Jm)V{9\x)] 


H2{x)  = - eB(*))2. 

»=i 

The  main  result  of  Ghosh  (1992)  is  now  stated  as  follows. 

Let  Xq  = {x  : H2(x)  > 0}  then  for  x € Xq,  the  solution  t of  (1.1)  subject  to 
(1.2)  and  (1.3)  is  given  by  eCB(x ) = (efs(x),  ...e^B (x))T , where 

efs(a:)  = aef  (a)  + (1  - a)eB(x),  i = 1, 

a = a(x)  — [1  + Hi(x)/H2{x)]1^2.  (1.4) 


We  shall  refer  to  eCB  as  the  Constrained  Bayes  (CB)  estimate  of  9.  Equation 
(1.4)  has  the  deceptive  appearance  of  expressing  the  components  of  eCB  as  convex 
combinations  of  the  Bayes  estimates  ef’s  and  their  average.  This  is  not  so,  because 
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a exceeds  1.  Also,  in  many  situations  especially  in  discrete  cases-there  is  a positive 
probability  that  H2(x ) is  0;  that  is,  ei(x ) = • • • = em(x).  Although  eCB  remains 
undefined  with  positive  probability  in  such  instances,  an  asymptotic  (as  m — » oo) 
version  of  such  estimators  still  may  be  meaningful.  Ghosh  (1992)  showed  this  for 
the  binomial  and  Poisson  examples.  Now  we  shall  discuss  CB  estimators  for  the 
one-parameter  exponential  family. 

Suppose  that  X\,  ...Am  are  m independent  random  variables,  where  A,-  has  the 
pdf  (with  respect  to  some  cr-finite  measure)  given  by 

Ui(xi)  = exp(n<piXi  - i = 1, ...,  m. 

Each  Xi  can  be  viewed  as  the  average  of  m iid  random  variables,  each  having 
a pdf  belonging  to  a one-parameter  exponential  family.  It  is  assumed  that  ip(-)  is 
twice  differentiable  in  its  argument.  The  objective  is  to  estimate  9i  = £^(Aj)  = 

-0' (<A»), 2 = l,...,m.  Assume  the  independent  conjugate  priors 

g{<pi)  = exp{v<pip  - vipicpi)) 

for  the  (pi's.  Then  under  quadratic  loss,  the  Bayes  estimates  of  9j's  are  given  by 

ef  (*)  = E{9i\x)  = E[ip' (<j>i)\x]  = (1  - B)xi  + Bp,  (1.5) 

where  B = v/{n  + u).  Also,  from  the  posterior  distribution  of  9,,  integration  by 
parts  gives 

V(9i\x)  = V[rl)'{<t>i)\xi]  = (n  + i/)_1E;[V'"(<k)N  = q,  (say).  (1.6) 

It  follows  from  (1.5)  that  H2(x)  = (1  - B)2  E^i(^«  - x)2,  whereas  from  (1.6),  one 
gets  Hi(x)  — (1  - m_1)  Qi ■ Then  the  quantity  “a”  is  determined  from  (1.4). 

Further  simplification  in  calculating  (see  Morris,  1982)  Hi  is  possible  when 
AVs  are  generated  from  QVF  (quadratic  variance  function)  subfamily  of  the 


natural  exponential  family.  Then, 


Ip"  {(pi)  = v0  + Viij}' + v2(ip' (fa))2  = w0  + v^i  + v2d2,  1 <i<rn,  (1 

where  Vo,rq  and  v2  are  not  simultaneously  0’s  and  v 2 < n + u . Then,  using  (1.6) 
and  (1.7), 

Qi  = (n  + v - v2)_1[uo  + vi ef(x)  + v2(ef  (*))2] 


so  that 

H1(x)  = (m  - l)(n  + v - v2)~l[vQ  + vieB(x ) + v2{(e(x))2  + m_1  H2(x)}]. 

Consequently,  for  x € X0, 

a2(x ) — [1  + v2(n  + v — v2)-1(l  — m-1)] 

+ (m  - 1 )(n  + 1'  - 'u2)~1[tio  + Vief(x)  + w2(ef  (x))2]/i/2(*)- 

In  the  normal  example  t»o  = cr2  (known),  whereas  «i  = v2  = 0.  Then 

m 

a2(a:)  = 1 + (to  — l)(n  + i/)-1(l  — B)~2  / y)(a?i  — x )2 

»=i 

m 

= 1 + (m- l)n_1a2/[(l  - B)^(x<  - x)2]. 

i=l 

In  the  normal  case  the  probability  that  all  the  JVj’s  are  equal  is  0. 

Ghosh  and  Kim  (2002)  have  extended  the  result  of  Ghosh  (1992)  when  the 
parameters  themselves  are  vector- valued. 

Suppose  0i, ...,  0m  are  the  to  vector-valued  parameters  of  interest  and 
ef  (x), ...,  e!^(x)  are  the  corresponding  Bayes  estimates  based  on  the  data  x 
under  any  quadratic  loss.  Then  writing  9 = to-1  #0  one  gets 
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771 

£[£(0i  - 0)($i  - 0)T|x]  - Jf  i(x)  + H2(x),  (1.8) 

i= 1 

where 

m 

Hl(x)  = '£V(Oi\x)-mV(d\x), 

i= 1 

771 

h2(*)  = X>f  (*)  ~ eB(*)][ef  (x)  - e®(x)]T. 

i=l 

Thus  the  posterior  mean  of  the  population  variability  of  the  0j’s  given  in  the 
left  hand  side  of  (1.8)  exceeds  the  corresponding  variability  among  the  ef ’s  by 
m_1  Hi  (x).  In  the  above  and  in  what  follows  we  say  that  two  symmetric  matrices 
A and  B satisfy  the  relationship  A > B if  A — B is  non-negative  definite.  We  will 
denote  the  (t,  j)th  element  of  H i(x)  by  Huj(x)  and  that  of  H 2(x)  by  H2ij(x). 

Generalizing  the  formulation  of  Ghosh  (1992),  the  objective  is  to  find  t\, 
which  minimize 

771 

E[J2(0i-ti)(ei-ti)T  |x]  (1.9) 

<=1 

subject  to 

771 

E(0\x)  = m-1  ^tj(x)  = t(x);  (1.10) 

«=1 

771  771 

- 0)(di  - ^)T|*]  = - *(*)][*<(*)  - (i-11) 

t=l  «= 1 

As  noted  already,  the  usual  Bayes  estimates  ef  (x),  ...,ef  (x)  of  0i, ...,  9m  satisfy 
(1.10)  but  not  (1.11).  The  following  argument  shows  how  a simple  modification  of 
ef  (x), ...,  ef  (x)  provides  the  desired  solution. 

Let  ef  (x), ...,  ef  (x)  denote  the  Bayes  estimates  of  Oi, ...,  Gm  under  any 
quadratic  loss  based  on  the  data  x.  Let  Xq  — {x  : H2jj(x)  > 0 for  all  j = 1,  ...,m}. 
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Then  for  x G X0,  the  solution  t\,  of  (1.9)  subject  to  (1.10)  and  (1.11)  is  given 
by  efs(a;), ...,  e^B{x),  where 

efB(x)  = Gef(x)  + (I  - G)eB(x),  i — 1, 


where  G = G(x)  is  a diagonal  matrix  with  jth  diagonal  element  given  by 

[(Hi  jj(x)  + H2ji(x))/HVJ(x)]l. 


Ghosh  derived  constrained  Bayes  estimators  in  a number  of  situations.  He  also 
derived  constrained  empirical  Bayes  estimators  including  the  constrained  empirical 
Bayes  analogue  of  the  celebrated  James-Stein  estimators. 

James-Stein  estimators  (James  and  Stein,  1961)  have  long  been  popular 
among  statisticians.  The  theoretical  interest  in  these  estimators  stems  from  their 
minimaxity  and  other  related  properties.  On  the  other  hand,  practitioners  have 
found  these  estimators  quite  appealing  in  the  context  of  simultaneous  estimation 
of  parameters  when  there  is  a clear  need  for  borrowing  strength.  While  the  original 
James-Stein  estimators  shrink  the  multivariate  sample  mean  towards  some  prior 
mean,  Lindley’s  (1962)  modification  of  the  same  shrinks  the  sample  mean  towards 
some  grand  average  of  the  component  sample  means.  All  these  estimators  have  an 
interesting  empirical  Bayes  (EB)  interpretation. 

Efron  and  Morris  (1973)  showed  how  James-Stein  estimators  arise  naturally  in 
an  empirical  Bayes  context.  We  begin  with  the  situation  where  X\0  ~ N(0,  Im). 

Suppose  that  the  prior  distribution  for  9i  is  7V(/q,  A).  Assuming  the  squared 
error  loss,  the  Bayes  estimator  of  0*  is  given  by 


E(9i\Xi  = Xi) 


Xi  + Hi/ A A 1 

1 + 1 /A  = A + lXi  + A + 1M< 

+ (!  “ ~ Mi) 

/ij  + (1  — S)(a?j  /^i)> 
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where  B = (1  4-  A)-1. 

Suppose  that  /z  is  known,  but  A is  unknown,  and  it  has  to  be  estimated  from 
the  data.  Note  that  X ~ N(n,B~lIm).  Thus,  marginally,  ||X  — /lz||2  ~ 

Hence, 

Substituting  this  estimator  for  B,  one  gets  the  estimator  for  6 as 

777  O 

S(X)=M  + (l-j  - -)(X-M). 

Thus,  the  estimator  S shrinks  X towards  an  arbitrary  point  /z. 

Suppose  now  that  /zT  = (/u,  ...,/z)  and  /z  and  A are  unknown.  Now,  marginally 
X is  N(nlm,  B~l Im).  In  this  case  (X,  £(Xj  — X)2)  is  complete  sufficient  for  (fi,A). 
Since  — X)2  ~ B~1Xm- 1>  the  UMVUE  for  B is  given  by  ^(x~-x)2  when 
m > 4.  Also,  X is  the  UMVUE  for  /z.  Since,  in  this  case  the  Bayes  estimator  of  6 is 

E(9i\Xi  = xt)  = = (1  ~ B)Xi  + B[L 

= /z+  (1  - B)(Xi  — /z),  * = 1, ...,  m. 

Substituting  the  UMVUE  estimators  of  /z  and  B,  it  follows  that  the  empirical 
Bayes  estimator  of  6 is 

0EB(X)  = Xlm  + (1  - - Xlm). 

It  can  be  shown  that  dEB(X ) also  dominates  X for  m > 4.  The  estimator  GEB(X ) 
shrinks  the  usual  estimator  X of  6 towards  X,  and  was  proposed  by  Lindley 
(1962). 

In  this  set-up,  constrained  empirical  Bayes  estimators  are 


0CEB(X)  — asB^EB  (X)  + (1  — o,EB)eEB  (-X')j 
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where  writing  S2  = — A)2/(m  — 1),  B — (m  — 3)/52,  a\B  = a2EB(x)  = 

+ (l-B)2S2^  — (1-B)S21‘ 

Constrained  estimators  were  further  generalized  by  Shen  and  Louis  (1998)  who 
proposed  the  development  of  “triple-goal”  estimates,  those  producing  a histogram 
that  is  a good  estimate  of  the  parameter  histogram,  with  induced  ranks  that 
are  good  estimates  of  parameter  ranks  and  with  good  performance  in  estimating 
unit-specific  parameters.  They  showed  that  a Bayesian  procedure,  when  suitably 
modified,  would  meet  all  the  three  criteria,  and  compared  them  with  posterior 
means  and  constrained  Bayes  estimates.  Also  Shen  and  Louis  (1998)  suggested 
additional  study  of  empirical  Bayes  estimators  and  use  of  a loss  function  other  than 
the  squared-error  loss  function. 

CB  or  CEB  estimators  have  mostly  been  derived  under  squared  error  loss. 

One  exception  is  Cressie  (1989),  who  considered  weighted  squared  error  loss  for 
obtaining  adjusted  census  counts.  However,  as  pointed  out  by  Louis  (2001),  there 
is  a need  for  developing  such  estimators  for  the  other  losses  as  well.  One  such  loss 
considered  in  this  dissertation  is  the  so-called  balanced  loss  function. 

Balanced  loss  functions  were  introduced  by  Zellner  (1988,1992).  Such  losses 
are  formulated  to  reflect  two  criteria-goodness  of  fit  and  precision  of  estimation.  As 
noted  by  Zellner  (1992),  least  squares  estimators  reflect  goodness  of  fit  considera- 
tion, while  quadratic  losses  (which  includes  the  squared  error  loss)  are  geared  solely 
towards  precision  of  estimation. 

It  is  well  recognized  that  sole  emphasis  on  the  precision  of  estimation  cri- 
terion, for  example  mean  squared  error,  can  lead  to  biased  estimators.  In  some 
circumstances  bias  is  not  important,  but  in  others,  it  is  critical.  Thus  there  is  a 
need  to  provide  a framework  within  which  the  tradeoff  between  goodness  of  fit,  or 
lack  of  bias,  and  precision  of  estimation  can  be  considered  formally.  Zellner  (1992) 
suggested  a balanced  loss  function  (BLF)  which  meets  this  need. 
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The  BLF  is  defined  as 

L(0,d)  = u>\\x  — d\\2  + (1  — u;)||0  — d||2 

where  ||  ■ ||  denotes  the  Euclidean  norm  and  w is  weight. 

The  first  term  on  the  right  hand  side  represents  goodness  of  fit  while  the 
second  represents  precision  of  estimation.  Under  BLF,  the  Bayes  estimates  are 
not  posterior  means  of  parameters  of  interest  any  more.  We  first  consider  the 
estimation  of  a scalar  mean  and  then  estimation  of  a vector  mean  relative  to 
balanced  loss  function  (BLF). 

Let  XT  = (Xi,X2, ... ,Xm ),  the  observation  vector  satisfies 

X — 91m  + u 

where  9 is  the  common  mean  of  the  AVs,  lm  is  an  m x 1 vector  with  all  elements 
equal  to  one,  and  u is  an  m x 1 error  vector.  Our  problem  is  to  estimate  9, 
assuming  that  a posterior  density  for  9 , with  some  prior  informations  are  available. 
A BLF  for  9 , denoted  LB(9 , 9),  where  9 is  some  estimate,  is  given  by 

Lb{9,  9)  = w(x  - 91m)T(x  - 91m)  + (1  - w)(9  — 9)2m , (1.12) 

with  w having  a given  value  in  [0, 1].  The  first  term  in  the  right  hand  side  of  (1.12) 
represents  goodness  of  fit  while  the  second  represents  precision  of  estimation. 

We  can  re-express  (1.12)  as  follows: 

Lb(9 , 9)  = w[a2  + (9  — x )2]  + (1  — w)(9  — 9)2, 

where  a2  = (x  — xl)T(x  — xl )/m  and  x is  the  sample  mean.  Then  posterior 
expected  loss  is 

E[Lb(9,  0)|*]  = w[d2  -t - (9  — x)2]  + (1  - w)[(9  - §B )2  + w] 


(1.13) 
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where  9B  is  the  posterior  mean  and  v = E[(9  — 9B)2 |x]  is  the  posterior  variance.  On 
completing  the  square  on  9 in  (1.13),  we  have 

E[LB(9 , 9)\x ] = wo2  + (1  — w)v  + w(l  — w)(x  — 9B )2  + (9  — 0*)2,  (1.14) 

where 

9*  = wx  + (1  — w)9b.  (1.15) 

From  (1.14),  it  is  clear  that  9 * in  (1.15)  is  the  value  of  9 that  leads  to  minimal 
posterior  expected  loss  and  is  thus  the  Bayesian  estimate  of  9 relative  to  BLF  in 
(1.12). 

Thus  conditional  on  the  data  and  prior  information,  0*  in  (1.15)  is  optimal  in 
the  sense  of  providing  minimal  posterior  expected  loss.  If  w = 1 in  (1.15),  9 * = x, 
while  if  w = 0,  9,  = 9B. 

In  the  multivariate  case,  consider  the  model 

X = 0 + u, 

where  9T  = {9\,  92,  ■■■,  9m ) and  uT  = («i,  u2, ...,  um).  The  uj s are  assumed  to  be 
iid  iV(0,<72).  Thus  Xi  is  normally  distributed  with  mean  9j  and  variance  a2.  The 
problem  is  to  estimate  6 relative  to  the  following  BLF: 

Lb(6 , 0)  — w(x  — 0)T(x  — 6)  + (1  — w)(0  — 9)T(d  — 9)  (1.16) 

where  9 is  some  estimate  of  9 and  w is  a given  weight,  0 < w < 1.  The  first 
term  on  the  r.h.s.  of  (1.16)  represents  goodness  of  fit  while  the  second  represents 
precision  of  estimation. 

Thus  the  first  problem  is  to  find  a value  of  9 which  minimizes  the  posterior 
expectation  of  the  loss  function  in  (1.16).  Given  a posterior  probability  density 
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function  for  9 , one  finds 

E[LB(9,9)\x]  = w(x  — 9)T{x  — 9) 

+ (1  - w)E{{6  -9B  -{9-  9B)}t{9  -9B  -{9-  0B)}|s] 

— w(x  — 9)T  (x  — 9)  + (1  — w)(9  — 9B)t(9  — 0B ) 

+ (1  -w)E[{9-0B)t{9-0B)\x\  (1.17) 

- B ~ 

where  9 is  the  posterior  mean  of  9.  On  completing  the  square  on  9 in  (1.17),  we 
have 

E[Lb(9,9)\x\  — (9  — 9 )t(9  - 9*)  + w(l  - w)(x  — 9B)t(x  — 9B) 

+ {l-w)E[{9-9B)T{9 -9B)\x] 

where 

9 = wx  + (1  — w)9  . 

From  (1.17),  9 is  the  value  of  9 that  minimizes  posterior  loss. 

As  an  example,  let  Xi, ...,  Xm\9\, ...,  9m  ~ N(0i,  1)  and  9i  ~ assuming 

H,  A is  unknown.  Marginally  Xi  ~ 1 /B),  where  B — (1  + A)-1. 

Under  the  balanced  loss  function  defined  as  before,  new  Bayes  estimators, 
which  are  not  the  posterior  means  any  more,  can  be  derived.  To  this  end,  we 
calculate 

E[Lb(9,9)\x]  — w\\x  — 0||2  + (1  — w)E[\\9  — 9 +9  — 0||2|a;] 

= w\\x  — 9\\2 

+ (1  - w){||$  - 0B||2  + E{\\9B  - 0||2|®)} 

A q 

where  w is  weight,  i.e.,  0 < w < 1,  and  9 = E{9\x). 
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Completing  the  square  on  G 


E[Lb(0,0)\x ] 


w(x  — G)T  (x  — G)  + (1  — w)(G  — G )T (6  — 6 ) 


+ (1  — w)E[\\G  — 0||2|a;] 

--  QT 0 — 20T (wx  + G — wG  ) 


* B * B 

+ (wx  + (1  — w)G  )T (wx  + (1  — w)G  ) 

B * B a B^  * B 

— (wx  + (1  — w)6  )T(wx  + (l  — w)d  ) + wxTx  + (1  — w)6  6 

+ (i-w)E[\\eB -e\\2\x] 

= (6  — (wx  + (1  — w)QB))t(G  — (wx  + (1  — w)G  )) 

+ w(l  — w)(x  — G )T (x  — G ) + (1  — iu)i?[||0  — 0||2|a;]. 


So,  our  new  Bayes  and  empirical  Bayes  estimators  under  balanced  loss  function  is 
as  follows: 


A WD  A D 

G = wX  + (1  — w)G  — wX  + (1  — w)[(l  — B)X  + 
= [1  - (1  - w)B]X  + (1  - w)Bnl 


* W F R A /\  _ 

0 = [1  - (1  - w)B]X  + (1  - w)BX  1 

where  B = (m  — 3)/  J2(Xi  — X)2,  m > 4. 

Note  that  in  case  of  w = 0,  it  is  an  empirical  Bayes  estimator  under  quadratic 
loss  function. 

1.2  The  Subject  of  This  Dissertation 

In  Chapter  2,  we  consider  the  asymptotic  expansion  of  the  MSE  of  constrained 
James-Stein  estimators.  This  expansion  is  valid  up  to  0(m~1).  We  also  provide  an 
estimator  of  the  MSE  which  is  asymptotically  valid  up  to  0(m_1),  m denoting  the 
number  of  strata.  A simulation  study  is  undertaken  to  evaluate  the  performance  of 


these  estimators. 
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Chapter  3 develops  constrained  Bayes  and  empirical  Bayes  estimators  un- 
der balanced  loss  functions.  In  particular,  such  estimators  are  derived  under  the 
one-parameter  exponential  family  of  distributions.  In  the  normal-normal  example, 
asymptotic  expansions  of  MSE’s  of  the  Bayes  and  empirical  Bayes  estimators  are 
provided  which  are  asymptotically  valid  up  to  0(m_1).  In  addition,  similar  asymp- 
totic expansions  of  MSE’s  of  constrained  Bayes  and  empirical  Bayes  estimators  are 
also  provided.  Estimators  of  these  MSE’s  asymptotically  valid  up  to  0(m~1)  are 
also  provided. 

Chapter  4 develops  constrained  Bayes  and  constrained  empirical  Bayes 
estimators  for  the  random  effects  balanced  normal  ANOVA  model  when  both 
variance  components  are  unknown.  The  asymptotic  MSE’s  valid  up  to  0(m-1)  are 
derived  as  in  the  previous  chapters. 

Finally,  in  Chapter  5,  we  summarize  the  result  of  this  dissertation  and  propose 
several  topics  for  future  research. 


CHAPTER  2 

ASYMPTOTIC  MEAN  SQUARED  ERRORS  AND  ESTIMATION 

2.1  Introduction 


James-Stein  estimators  (James  and  Stein,  1961)  have  long  been  popular 
among  statisticians.  The  theoretical  interest  in  these  estimators  stems  from  their 
minimaxity  and  other  related  properties.  On  the  other  hand,  practitioners  have 
found  these  estimators  quite  appealing  in  the  context  of  simultaneous  estimation 
of  parameters  when  there  is  a clear  need  for  borrowing  strength.  While  the  original 
James-Stein  estimators  shrink  the  multivariate  sample  mean  towards  some  prior 
mean,  Lindley’s  (1962)  modification  of  the  same  shrinks  the  sample  mean  towards 
some  grand  average.  All  these  estimators  have  interesting  empirical  Bayes  (EB) 
interpretation  (see  Efron  and  Morris,  1973). 

However,  as  discussed  in  the  previous  chapter,  the  histogram  of  the  posterior 
means  of  co-ordinate  specific  parameters  is  underdispersed  as  an  estimate  of  the 
parameter  histogram.  The  EB  estimators,  usually  derived  from  the  posterior  means 
by  plugging  in  estimators  of  the  hyperparameters,  share  the  same  feature.  It  is 
thus  clear  that  with  the  twin  objective  of  simultaneous  estimation  of  parameters 
under  the  quadratic  loss,  and  achieving  closeness  of  the  histogram  of  the  posterior 
means  with  the  posterior  estimate  of  the  parameter  histogram,  the  usual  Bayes  or 
EB  estimators  are  clearly  inappropriate.  Indeed,  any  single  set  of  values  cannot 
simultaneously  optimize  the  two  goals.  However,  in  many  policy  settings  reporting 
a “single”  set  of  estimates  with  “good”  performance  for  these  two  goals  is  a clear 
necessity. 

Louis  (1984)  addressed  this  problem  by  matching  the  first  two  empirical 
moments  of  the  Bayes  estimates  of  the  normal  means  with  the  corresponding 
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moments  derived  from  the  posterior  histogram.  The  Bayes  estimators  which 
meet  these  constraints  are  referred  to  as  constrained  Bayes  (CB)  estimators. 

Louis  proposed  also  constrained  empirical  Bayes  (CEB)  estimators  in  the  original 
James-Stein  framework.  Ghosh  (1992)  developed  CB  estimators  in  a more  general 
framework  when  the  distribution  was  not  necessarily  normal. 

As  a natural  next  step,  one  needs  to  find  measures  of  precision  associated 
with  the  CEB  estimators.  Reporting  a set  of  estimates  without  any  associated 
measures  of  uncertainty  is  against  standard  statistical  practice.  Indeed,  very  often 
measures  of  precision  along  with  the  estimators  are  demanded  by  users  of  the 
data.  For  example,  in  finding  asymptotic  confidence  sets  for  the  parameter  vector 
of  interest  centered  at  the  CEB  estimators,  one  needs  at  least,  some  asymptotic 
approximation  of  its  mean  squared  error  (MSE).  Throughout,  we  will  use  the  term 
MSE  as  equivalent  to  the  Bayes  risk.  Unlike  the  regular  James-Stein  estimators,  it 
seems  impossible  to  find  exact  MSE’s  of  the  CEB  estimators.  We  provide  instead 
the  asymptotic  MSE’s  of  these  estimators  which  are  correct  up  to  order  0(m-1). 

We  find  also  bias-corrected  estimators  of  these  MSE’s  which  are  also  asymptotically 
valid  up  to  0(m-1).  Our  results  are  thus  similar  in  spirit  to  those  of  Prasad  and 
Rao  (1990),  Lahiri  and  Rao  (1995)  and  Datta  and  Lahiri  (2000). 

We  may  point  out  that  when  the  Bayesian  model  is  true,  the  Bayes  esti- 
mators have  the  smallest  Bayes  risks.  The  CB  estimators  cannot  claim  any  risk 
improvement  over  the  Bayes  estimators.  The  same  phenomenon  is  reflected  in  the 
comparison  of  EB  and  CEB  estimators.  The  CEB  estimators  are  not  designed  to 
improve  on  the  EB  estimators  by  producing  smaller  MSE’s.  They  are  constructed 
to  meet  the  twin  objectives  as  mentioned  earlier  in  this  section  more  satisfactorily 
than  the  EB  estimators. 

In  Section  2 of  this  chapter,  we  provide  the  asymptotic  expansion  of  the  MSE 
which  is  correct  up  to  0(m-1).  Section  3 contains  estimators  of  the  MSE  which  is 
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also  asymptotically  valid  up  to  0(m_1).  Section  4 contains  some  simulation  results 
demonstrating  the  accuracy  of  all  the  approximations. 

2.2  The  Asymptotic  MSE 

Consider  the  usual  normal-normal  model  where  Xi\9i  are  independent  N(0j,  1), 
while  $i  are  iid  N(/z,  A).  Let  9 = (9i,  ■ ■ • , 9m)T . For  an  estimate  d — (rfi,  • • • , dm)T 
of  0,  consider  the  loss  L (0,  d)  = m_1||0  — d||2,  where  ||  ■ ||  denotes  the  Euclidean 
norm.  Then  the  Bayes  estimator  of  6 is  given  by 

9°  = (9?  (X),..J°(X))T, 

where  9f(X)  = (1  — B)Xi  + B/j,,  i = 1,  • • • , m,  B = (1  + A)~l. 

2.2.1  Constrained  James-Stein  Estimators 

Following  Louis  (1984)  and  Ghosh  (1992),  the  CB  estimator  of  9 is  given  by 

0 = ^b[(1  — B)X  -I-  B(ilm]  + (1  — «b)[(1  — B)X  + Bfj] lm 

— (1  — B)[asX  + (1  — aB)Xlm]  -I-  Bfilm,  (2.1) 

where  lm  is  an  m-component  column  vector  with  each  element  equal  to  1,  X = 
m-1  E£i  Xif  a%  = 1 + and  5 - (*  - Xf/{m  - 1). 

In  an  EB  scenario,  typically  both  /x  and  A are  unknown,  and  are  esti- 
mated from  the  marginal  distribution  of  X = (Xi,  • • • , Xm)T . Marginally, 

X ~ B~lIm).  Hence,  marginally,  S ~ i/(m  — !)■  We  esti- 

mate /x  by  X,  and  B by  B — min(^5f,  |),  where  d > 1.  For  our  asymptotic  MSE 
expansion,  any  d > 1 should  do.  Morris  (1981)  takes  d = 3.  The  constrained  EB 
estimator  of  9 is  then  given  by 

* r'PB  A A _ 

9 = (1  — B)[o,ebX  + (1  — a,EB)Xlm\  + BXlm,  (2.2) 

where  qeb  replaces  B by  B in  aB. 
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p.  (JtitS 

Under  the  assumed  loss,  the  MSE  of  6 is  given  by 

mse(0cbb)  = m-lE\\bCEB  -e\\2 

= m-'E\\bCEB  -eB  + eB  -G\\2 
= m~l[E\\bCBB -0B\\2  + E\\bB -0\\*].  (2.3) 

A jq 

The  product  term  disappears  since  E(9  — 0\X)  = 0. 

It  is  well-known  that 

A D ^ A 

m~xE\\e  -e\\2  = m~1YlE(ef -Oi)2  = 1- B.  (2.4) 

i=i 

-CEB  -B 

The  following  theorem  provides  an  asymptotic  expansion  of  m 1E\\6  —0  \ p 

correct  up  to  0(m_1). 

Theorem  2.1  Under  the  given  model  and  the  loss, 

m~1E\\9CBB  — 0B||2  = - + fo-"-1*  - (i  - B)1!2]2  + —5(1  - B)^2 

m m B 2m 

+ o(m~1).  (2.5) 

Remark  2.1  Combining  (2.3)-(2.5),  one  gets 

MSE(0CBB)  - 1-B  + B~1(1-B)[1-(1-B)1/2]2 

+ m_1[R  - B_1(l  - B){  1 - (1  - Bf'2}2  + (1/2)B(1  - B)~1/2] 
+ o(m~1).  (2.6) 

Proof  of  Theorem  2.1  First,  by  (2.1)  and  (2.2)  we  get 

eCEB-eB  = ( 1 - B)[aEBX  + (1  - aEB)Xlm]  + BXlm  - (1  - B)X  - Bfxlm 
= aEB(  1 -B)(X-  Xlm)  + Xlm  - (1  -B)(X-  Xlm) 

- {l-B)Xlm-Bnlm 

= B(X  - fj)lm  + [aEB(  1 - B)  - (1  - B)](X  - Xlm). 


(2.7) 
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From  the  independence  of  X and  X — Xlm,  and  the  fact  that  X ~ 
iV(/z,  (mB)'1),  we  get  from  (2.7) 

m-lE\\9CBB  - 0S||2  = - + ^[{aEB(  1 — B)  — (1  — B)}2S].  (2.8) 

m m 

Let  g(S)  = [aBB(  1 — B)  — (1  — B)]2S.  We  write  p(5)  = gi(5)  + <72 (<S )>  where 
p1(*S')  = p(*S,)/[5>i+£m]  and  g2(5)  = 0(S)/[s<i+«m].  where  em  = 0(m~Q),  and 
a G (0, 1)  will  be  chosen  later.  Next  we  use  the  inequality, 

92(S)  < 2[a|s(l  - B)2  + (1  — B)2]5/[5<i+em] 

= 2[(1  - B)2S  + 1 - B + (1  - B)2S]/[s<1+£m] 

< 2[5  + 1 + S]I[S<  l+em] 

< 2[2(1  + em)  + l]/[s<i+em]- 


Hence, 


■^'[52(5')]  < 2[2(1  + em)  + 1]P(S  < 1 + em). 
Since  S ~ B_1Xm- i/(m  ~ 1)  s0  that  B(5)  = B_1,  we  get 


P(S<l  + em)  = P(S  - B-1  < 1 - B-1  + em) 


(2.9) 


(2.10) 


where  m is  taken  sufficiently  large  so  that  B 1 — 1 — em  > 0.  Now  by  Markov’s 
inequality, 

P(|S  - B-‘|  > B-'  - 1 - em)  < (jjE|1S_~B_"^)r  = O(m-P)  (2.11) 

for  r > 0.  Choose  r > 2 so  that  the  right  hand  side  of  (2.11)  is  0(m-1).  Combining 
(2.9)-(2.11), 


^[32(5)]  = o(m  1). 


(2.12) 


Next  observe  that  when  S > 1 + em,  5_1  < (1  + em)-1  = [1  + 0(m_Q)]_1,  while 
(m  — d)/(m  - 1)  = [1  + (d  — l)/(m  - d)]_1  = [1  + 0(m-1)]-1. 

Since  for  large  m,  1 + 0(m-a)  > 1 + 0(m_1),  5_1  < (m  — d)/(m  — 1)  for  large 
m.  Hence,  for  large  m,  5 = S'-1.  Thus, 

Ji(S)  = [(srr)1/a(^)  - ('  - B)JJsr(5>1+fc>, 

= [S  - 1 + (1  - B)2S  - 2(1  - B)S'/2(S  - i)1/2]/[s>1+,„] 

= h(S)I[S>  i+em]  say, 

where 

h(x)  = x — 1 + (1  — B)2x  — 2(1  — B)x1/2(x  — 1)1/2,  *>1.  (2.13) 

By  Taylor  expansion  again, 

h(S)  = /i(£S)  + (S  - £S)/i'(£S)  + Us  - ES)2h"{ES) 

+ 1 [S  {S-  x)2h"'(x)dx,  (2.14) 

where  by  (2.13),  for  x > 1, 

h'(x)  = 1 + (1  — B)2  — (1  — B){x-1/2(x  - 1)1/2  + x1/2{x  - 1)~1/2}; 
h"(x)  = l^{x-W(x-l)1'2-2x-1'2(x-l)-1'2  + x1'2(x-l)-3'2} 

Z 

= ^aT3'2^  - 1)~3/2; 
z 

/»'"(*)  = -3(1~B)a;-5/2(x  - l)_5/2(2a;  - 1). 

On  simplification, 

h(ES)  = h{B~1)  = S-1  — 1 + (1  — 5)25_1  — 2(1  — B)B~1^2(B~1  — 1)_1/2 
= 5-1(l-B)[l-(l-S)1/2]2; 


(2.15) 
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Note  also  that  E[h(ES)I[s< i+Cm]]  = o(m  x)  and  by  the  Schwarz  inequality 

E\(S-ES)h'(ES)I[s<1+eJ  = \h'(ES)\E\(S-ES)I[s<1+tm]\ 

< \h!{B~l)\Ell2(S  - ES)2P1/2(S  < 1 + em) 

= |/i'(£-1)|0(m-1/2)0(m-r/4) 

= o(m_1),  (2.17) 

by  choosing  r > 2.  Also, 

£[(5  — £?5,)2/i"(£,5)/[s<i+em]]  = h"(B-1)E[(S-ES)2I[s<1+em]\ 

< h"{B~l)Ell2{S  - ES)4P1/2{S  < 1 + em) 

= 0(m-1~r/4 ) = o(m_1)  for  r > 0.  (2.18) 

Noting  h{ES)  = h(ES)I[s>1+em]  + h(ES)I[s< i+fm]  = h(ES)I[s> i+£m]  + o(ra-1),  and 
similarly  h'(ES)  = h'(ES)I[S> i+Cm]  + o(m_1),  h"{ES)  = /i(^5)/[S>i+em]  + o(m_1), 
it  follows  from  (2.14)-(2.18)  that 

E[gi(S)]  - E[h(S)I[s>1+em]\ 

= h(ES)  + E(S  - ES)h'(ES)  + ^E{S  - ES)2h"{ES ) 

Z 

+ \E^eJ<S  ~ X)2ti"(X)dxI[S>l+err,}]  + 0(m_1) 

= B-\  1 - B)[l  - (1  - B)1/2]2  + ^(m_21)g2^3(l  - B)~1/2 

+ \E\-Jes(S  - x)2ti"{x)dxl[s> i+em]]  + o(m_1) 

= S-X(l  - B)[  1 - (1  - 5)1/2]2  + -*-B(  1 - 5)~1/2 

2m 

+ \E\-Jes(S  - x)2h'"{x)dxI[S>  1+tm]]  + o(m_1). 


Finally,  since  5 > 1 + em  and  £(£>)  — B 1 > 1 + em  for  large  m, 
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E[  I f* *s(S-x)2h'"(x)dx\I[s>1+Cm] } < Ml_^)em5/22S[|  Jjs  - x)2dx\I[S>1+eJ 

< 3^~Bhm5/2E\S-ES\3 
= 0{m5a'2~3'2)  = oim-1)  (2.19) 

if  < —1,  i.e.,  a < 1/5.  Combining  (2.8),  (2.12)  and  (2.19),  one  gets  (2.5). 

2.2.2  Positive-Part  James-Stein  Estimators 

We  first  observe  that 

~ EB  ~ /s  _ 

9 = (1  - B)X  + BXlm.  (2.20) 

Here  we  may  recall  that  B = min(^5y,  |)  and  S — £™i(^»  — X)2/(m  — 1).  Then, 

- EB 

under  the  assumed  loss,  the  MSE  of  9 is  given  by 

MSE {9EB)  = m-1E\\9EB -9\\2 

= m~lE\\9EB  -9B  + 9B  -9\\2 
= m-^EWO^ -9B\\2  + E\\9B -9\\2} 

= l-JB  + m-1[£||0BS-0S||2] 

* EB 

The  following  theorem  provides  an  asymptotic  expansion  of  MSE  of  9 
correct  up  to  0(m-1). 

Theorem  2.2  Under  the  given  model  and  the  loss, 

m-1£||0BS  — 0B||2  — 1 — B + — + o(m_1). 

m 

Proof  of  Theorem  2.2  First,  by  (2.1)  and  (2.20)  we  get 

A E>D  A D A /v  _ 

9 -9  = {l-B)X  + BXlm-{l-B)X-Bnlm 

= (B  - B){X  - Xlm)  + B(X  - n) lm. 
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After  some  simplification, 

m-'EWO1*13  - G\\2  = 1 - B + Bm-1  + -E[(B  - B)2S].  (2.21) 

TJX 

Writing  once  again  B = 5_1,  and  by  E[S]  = B*1, 

E[(b-B)2S ) = EiS”1  - 2B  + B2S] 

= {-m~l)B+B 
m — 3 

= 2B{m  - 3)_1  for  m>  4,  (2.22) 

and  it  follows  after  some  simplifications  and  calculations  with  same  technique  as 
before, 

E[(B  - B)2S } = o(m_1).  (2.23) 

A 

Combining  (2.21)-(2.23),  it  follows  now  that  MSE  of  6 correct  up  to  0(m~1)  is 
given  by  1 — B -h 

The  next  section  will  be  devoted  to  asymptotic  estimation  of  the  MSE. 

2.3  Estimation  of  the  MSE 

This  section  is  devoted  to  estimation  of  the  MSE  derived  in  Section  2.  We  find 
estimators  which  are  asymptotically  correct  up  to  0(m~x). 

2.3.1  Constrained  James-Stein  Estimators 

First,  by  (2.6)  we  express  m~lE\\0  — 9\\2  as 

A 

m~xE\\6  — 6^  = w\{B)  + m~1W2{B)  + o{m~x),  (2.24) 

where  wx {B)  = 1 - B + A(B),  A(B)  = B~l(  1 - 5)[1  - (1  - B )1/2]2  = 2 B~x  - 3 + 
B - 2B_1(1  - B)3/2,  and  w2{B)  — B - A{B)  + C{B),  C(B)  = (1/2)B(1  - B)"1/2. 

The  following  theorem  provides  estimators  of  the  MSE  of  constrained  James- 
Stein  estimators  which  is  asymptotically  correct  up  to  0(m-1). 
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Theorem  2.3  The  0{m  *)  bias-corrected  estimator  of  the  MSE  of  QCEB  is  given 
by 


m1(B)  + m-1K(S)  + (3/2)C'(B)], 


where  Wi(B),  w2(B)  and  C(B ) are  defined  after  (2.24). 

Proof  of  Theorem  2.3  We  begin  with 

E[(  1 - 5)J[s<1+£m]]  < P(S  < 1 + em)  = 0(m~r)  = ofm"1)  for  r > 2; 

i?[(l  — S)/[S>i+em]]  = £'[(1  — S 1)/[5>i+e,„]]  = E[g0(S)I[s  >i+£m]], 

where  go{x)  = 1 — x~x,  9o(x)  = x~2i  9o(x)  = — 2a;-3,  and  g'o(x)  = Qx~4.  By  Taylor 
expansion, 

g0(S)  = g0(ES)  + (S-ES)g'0(ES)  + (l/2)(S-ES)2g^ES) 

+ (1/2)  f (S  - x)2g'o(x)dx 

Jes 

where  g0(ES)  = 1-5,  y£(£S)  = -2 53 

Also  note  that  for  x > 1,  |<7o"(a;)|  < < 6.  Hence,  by  the  same  argument  as  in 

the  previous  section, 

£(1-5)  = 1 — 5 + (l/2)2[(m  — 1)52]-1(— 253)  4-  o(m_1) 

= 1 — 5 — 25m-1  + o(m_1)  (2.25) 


Next  note  that 

A(5)/[s<i+em]  < 5_1/[S<i+Cm] 

= max((m  - 1 )/{m  - d ),  S)I[S<i+tm] 


< (1  + em)-f[5<l+em]j 
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since  (m  — 1 )/(m  — d)  = 1 + 0(m  *)  < 1 + em.  Hence,  for  large  m, 

E[A(B)I[S<1+CJ  < (1  + em)P(S  <l  + em)<  0(m-r'2)  = o(m-1) 
for  r > 2 and  since  B = 5_1  for  5_1  < for  such  m, 

A0)I[S> ,+<m]  = [2S  - 3 + | - 2-(^-]J[»>i^| 

= u(S)I[S>  i+£m], 


where 


u(x)  = 2x  - 3 + - - 2(x  - l)3/2x~1/2. 
x 

By  Taylor  expansion  again, 


where 


u{S)  = u{ES)  + {S-ES)u'(ES)  + {l/2){S-ES)2u"(ES) 
+ (1/2)  J (S  — x)2u'"(x)dx, 

u'(x)  = 2-\-3(l-  -)1/2  + (1  - -)3/2; 

X*  X X 

"W  = 4 - f (1  - i)-I/2(^>  + fd  - ')I/J(3); 


XJ 


X xz 


'w  = -4  + 7(i-i)-s/2(3)  + ?(i-r)-,/2(A) 


-3(1-i),/2(^)+3(1-i)"‘/2<?) 


+ 3(±)(x  - 1 )-'* 

63.1..  1 

+ 7(^7o)( 


N 15/  1 W 


x4  4 x5/2 A(x  — l)3/2 y 4 Kx7P  K(x  — l)1/2 


>)• 


On  simplification 


27 


u(ES)  = u{B -1)  = 2 B-1  - 3 + B - 2B~1(1  - B)3/2; 


u"{ES)  = u"(B~l)  = 2B3  - ^B3(l  - B)~1/2; 

z 


-3/2 


-1/2 


and  |u'"(z)|  < + 4(i+?m)5/2  + 4{1+Tmjf72  = a m (say).  Hence, 

E[\  [S  (S-x)2u'"(x)dx\I[s>1+tm]\  < amE\S-ES\ 3 

«/  £J5 

= 0{m3a/2~3/2)  = o(m_1) 


for  a < 1/3.  Thus, 


E[A(B)]  = A{B)  + 2Bm~1  - (3/2)m“1B(l  - B)~1/2  + (/(nT1).  (2.26) 


Next 

E[B{  1 - ^)-1/2/[s<i+em]]  < £[(1  - B)-1/2/[5<1+em]j.  (2.27) 

Since  1 — B > (d  — l)/(m  — 1),  right  hand  side  of  (2.27)  is  less  than  or  equal  to 
{(m  — 1 )1/2/(d  — 1)1//2}P(5  < 1 + em)  = 0(m1^2~r^2)  — o{m~l)  by  choosing  r > 3. 
Again, 

B(1  - B)-V2/|s>1+„,  = 1(1  - 

= S-'/\S  - l)-1/2/[s>i+«„i 
— Q(S)I[S>  l+tm]l 

where  q(x)  = x~1^2(x  — l)_1/<2.  By  Taylor  expansion, 

q(S)  — q{ES)  + f q'(x)dx, 

JES 


where  q(ES)  - q{B  x)  = B(  1 - B ) 1/2  and  q'(x)  — 
Thus, 
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2a- 1 


for  x > 1 + em. 


2x3/2(x— l)3/2 


for  x > 1 + em.  Finally, 


E[<l(s)I[s>i+em]\  = B(  1 - B)  1/2  + E[{  f q'(x)dx}I[s> i+£m]]  + o(m  *) 


and 


E[{  [S  q'(x)dx}I[s>l+eJ  < e~3'2E\S  - ES\  - 0(m3a^2)  = o(l) 

J ES 


for  a < Hence 


E[C(B)]  = C(B)  + o(  1). 


(2.28) 


Combining  (2. 24), (2. 25), (2. 26)  and  (2.28),  it  follows  that 

E[wi(B)  + m~* 1W2{B)]  = wi(B)  + m~1w2(B ) - (3/2 )m~1C(B)  + o(m_1). 


2.3.2  Positive-Part  James-Stein  Estimators 

Now  we  consider  the  estimators  of  the  MSE  of  positive-part  James-Stein 
estimators  derived  in  section  2.  As  same  argument  with  constrained  James-Stein 
estimators,  the  following  theorem  provides  estimators  of  the  MSE  of  parsitive-part 
James-Stein  estimators  which  is  asymptotically  correct  up  to  0(m-1). 

Theorem  2.4  The  0(m_1)  bias-corrected  estimator  of  the  MSE  of  9EB  is  given 


by 


1 - B + bm-'B. 


Proof  of  Theorem  2.4  By  (2.25),  we  know 


E[B\  = B + — + o(m~1), 


(2.29) 
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so  we  can  get 

OJD  Oft 

Ml-  B + 3m-1B]  = 1 -B+ + ofm"1)  (2.30) 

m m 

Combining  (2.29)  and  (2.30),  it  follows  that 

O D 

E11-B  + 5m_1  B]  = 1 -B  + — . 

m 

2.4  Numerical  Calculations 

In  this  section,  we  report  the  results  of  a simulation  study  to  demonstrate  the 
accuracy  of  the  MSE  approximation  as  described  in  the  previous  section.  For  the 
sake  of  comparison,  we  consider  also  the  approximate  estimator  of  the  MSE  of  the 
the  positive-part  James-Stein  estimator  (the  usual  EB  of  0). 

2.4.1  Method 

We  now  discuss  the  simulation.  For  illustration,  we  consider  a simple  normal- 
normal  model  with  /z  = 0.  We  investigate  the  performance  of  the  simulated  MSE 
corresponding  to  (2.3)  as  well  as  the  asymptotically  estimated  MSE  of  the  CEB 
estimators  for  several  m.  The  simulated  MSE’s  of  the  EB  estimators  are  also 
calculated.  Different  values  of  A — 1,  2,  3 are  considered. 

Details  of  our  simulation  study  are  described  below. 

(a)  First  we  generate  0*  (i  — 1,  • • • , m)  from  the  N(0,  A)  distribution  with  fixed 
A value. 

(b)  For  given  0*  ( i = 1,  • • • , m),  we  generate  the  data  Xi,  i = 1,  • • • , m from 
the  N(0j,  1)  distribution.  We  repeat  steps  (a)  and  (b)  R = 10,000  times.  Then  we 
calculate  EB  and  CEB  estimates  for  each  simulated  data  set. 

(c)  Finally  we  compute  the  simulated  MSE’s 

m it  m R 

(mi?)-1  £ U%EB  - Oir)2  and  (mi?)-1  £ £(0t?fl  - 0,>)2 

i=l  r=l  i=l  r=l 
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for  different  values  of  m after  R — 10,  000  repetitions  of  the  experiment.  In 
addition,  we  calculate  asymptotically  estimated  MSE  of  the  CEB  estimates  for  the 
same  m values. 

2.4.2  Result 

Table  2.1  reports  the  values  of  the  simulated  MSE  of  EB  and  CEB  estimates 
as  well  as  the  asymptotically  estimated  MSE  of  the  CEB  estimates  for  m = 

10, 30,  50, 100,  300  and  for  selected  values  of  A.  Since  results  for  different  values  of  d 
are  similar,  only  the  case  d = 3 is  reported.  Not  surprisingly,  Table  2.1  shows  that 
the  simulated  MSE  and  asymptotic  MSE  for  the  CEB  estimates  are  fairly  close 
even  for  m = 50.  Also,  the  simulated  MSE’s  of  the  EB  estimates  are  relatively 
smaller  than  the  simulated  MSE’s  of  the  CEB  estimates.  The  intuitive  reason 
behind  this  is  that  the  MSE  of  an  EB  estimator  is  asymptotically  close  to  the  MSE 
(or  equivalently  the  Bayes  risk)  of  the  regular  Bayes  estimator,  while  the  MSE 
of  a constrained  EB  is  asymptotically  close  to  the  MSE  of  a constrained  Bayes 
estimator,  and  the  latter  has  clearly  larger  Bayes  risk  than  that  of  the  regular 
Bayes  estimator.  We  note  also  the  first  order  optimality  of  the  EB  estimator  noting 
that  its  Bayes  risk  tends  to  1 — (1  + A)~l  as  m — > oo. 
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Table  2-1:  Simulated  MSE’s  of  EB  and  CEB  estimates  as  well  as  asymptotic  MSE 
of  EB  and  CEB  estimates  for  selected  values  of  A and  m 


A 

m 

MSE 

Simulated 

(EB) 

Asymptotic 

(EB) 

Simulated 

(CEB) 

Asymptotic 

(CEB) 

10 

0.6040 

0.6500 

0.6643 

0.6627 

30 

0.5479 

0.5500 

0.6123 

0.6114 

1 

50 

0.5297 

0.5300 

0.6006 

0.6011 

100 

0.5147 

0.5150 

0.5930 

0.5935 

300 

0.5046 

0.5050 

0.5879 

0.5884 

10 

0.7582 

0.7667 

0.7839 

0.7810 

30 

0.6988 

0.7000 

0.7479 

0.7497 

2 

50 

0.6858 

0.6867 

0.7415 

0.7434 

100 

0.6760 

0.6767 

0.7378 

0.7387 

300 

0.6694 

0.6700 

0.7349 

0.7356 

10 

0.8263 

0.8250 

0.8411 

0.8379 

30 

0.7732 

0.7750 

0.8127 

0.8152 

3 

50 

0.7637 

0.7650 

0.8084 

0.8107 

100 

0.7567 

0.7575 

0.8062 

0.8072 

300 

0.7518 

0.7525 

0.8043 

0.8050 

CHAPTER  3 

CONSTRAINED  BAYES  AND  EMPIRICAL  BAYES  ESTIMATION  WITH 
BALANCED  LOSS  FUNCTION 

3.1  Introduction 

Constrained  Bayes  and  empirical  Bayes  estimators  are  developed  in  this 
chapter  under  balanced  loss.  As  mentioned  in  the  introduction,  such  losses  are  for- 
mulated to  reflect  two  criteria-goodness  of  fit  and  precision  of  estimation.  Zellner 
(1992)  noted  that  least  squares  estimators  reflect  goodness  of  fit  consideration, 
while  quadratic  losses  (which  includes  the  squared  error  loss)  are  geared  solely 
towards  precision  of  estimation.  He  introduced  the  balanced  loss  to  seek  a trade-off 
between  the  two. 

In  Section  2 of  this  chapter,  we  introduce  the  balanced  loss  and  derive  the  CB 
estimators  under  such  a loss.  Also  this  section  develops  the  CB  estimators  for  the 
one  parameter  natural  exponential  family  of  distributions  with  quadratic  variance 
functions  (NEF-QVF)  as  introduced  in  Morris  (1982,  1983).  We  also  provide  an 
asymptotic  expansion  of  the  Bayes  risks  of  the  CB  estimators  in  Section  2.  Section 
3 develops  EB  estimators  under  balanced  loss  functions  and  provides  an  asymptotic 
expansion  of  the  MSE  of  such  estimators  that  is  correct  up  to  0(m-1).  Second 
order  correct  estimators  of  the  MSE’s  of  these  estimators  are  also  provided.  CEB 
estimators  under  balanced  loss  functions  are  derived  in  Section  4,  and  once  again 
asymptotic  expansions  of  their  MSE’s  valid  up  to  0(m_1)  are  provided. 
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3.2  Constrained  Bayes  Estimators  and  Their  Bayes  Risks 
Let  X — ( Xi,...,Xm)T  with  E(X ) — 9 — {9i,...9m)T.  For  any  estimator 
e = (ei,  ...,em)T  of  9,  the  balanced  loss  as  introduced  by  Zellner  (1988,  1992)  is 

L(0,  e ) = m-1[«>||X  - e(X)||2  + (1  - w)\\e(X)  - 0||2],  (3.1) 

where  ||  • ||  is  the  Euclidean  norm  and  w (0  < w < 1)  is  the  known  weight.  The 
choice  of  w reflects  the  relative  weight  which  the  experimenter  wants  to  assign  to 
goodness  of  fit  and  precision  of  estimation.  The  extreme  cases  w = 1 and  w = 0 
refer  solely  to  the  precision  of  an  estimate  and  goodness  of  fit  respectively. 

3.2.1  Constrained  Bayes  Estimators 

Suppose  now  eB(X)  is  a Bayes  estimator  of  9 under  a prior  n.  Writing 
ePM(x ) = E(9\X  = x ) and  noting  that  £[||e(X)  — 0||2|X  = x]  = E[tr{V (9\x)}  + 
||e(x)  — eFM(x)||2],  minimization  of  E[L(9,  e)\X  = x]  with  respect  to  e amounts 
to  minimization  of  w\\x  — e(x)||2  + (1  — io)||e(x)  — ePM(x)||2  with  respect  to  e.  A 
slight  algebra  shows  that  the  minimizer  e is  given  by 

eB(x)  = wx  + (1  — w)ePM(x).  (3.2) 

The  estimate  eB  is  given  in  Zellner  (1988,  1992). 

However,  the  above  estimate  does  not  work  well  if  one  is  interested  in  finding 
an  optimal  estimate  of  the  histogram  of  the  population  parameters,  namely, 
m_1  TiiLi  I[6i<t]-  Indeed  writing  eB(x)  = (ef(x),  ...,eF(*))T,  it  is  now  clear  that 
eB(x ) = m-1  ef  (x)  = wx  + (1  — w)ePM(x)  ± ePM(x)  unless  w = 0,  where 

ePM(x)  = m_1  i E(9i\x).  Also  it  is  easy  to  check  that  E[m~l  £eLi(0i  — 9)2 |x]  ± 

m-1E^i(ef(a:)-eB(x))2. 
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Following  Louis  (1984)  and  Ghosh  (1992),  we  now  seek  compromise  estimators 
t = (ti,  of  6 which  satisfy 


(i)  t = m 1 y = ePM(x) 

i= 1 

m m 

(ii)  Elm-1  y^(tj  — t)2\x]  = m~l  y)  E[(9i  - 9)2\x],  (3.3) 

i=l  i=l 

and  minimize  E[L(0,t)\x]  with  respect  to  t subject  to  (i)  and  (ii)  in  (3.3).  The 
following  theorem  provides  such  compromise  estimators. 

A few  notations  are  needed  before  stating  the  result.  Let  H i(x)  = E£Li  V(9i  — 
9\x)  and  H2(x)  = 5^Li(ePM(x)  - ePM(x))2  so  that  E^=i-®[(^«  - 0)2|*]  = 

Hi(x)  + H2(x).  Also  let  bi(x)  — w(xi  — x)  + (1  — w)(efM  — ePM ),  1 < i < m.  Then 
the  following  result  holds. 

Theorem  3.1  Assume  (3.3).  Then  E[L(0,t)\x]  is  minimized  with  respect  to  t 
when 


U = U(x)  = 


Hi(x)  + H2(a 


1/2 


bi(x ) + ePM(x),  i = 1, ...,  m. 


(3.4) 


Proof  of  Theorem  3.1  Our  objective  is  to  minimize  E£Li  E[w(U  — Xj)2  + (1  — 
w)(ti  — Qi)2\x ] subject  (3.3).  Since  E[(ti  — 9i)2\x ] = V(9i\x)  + (i*  — ePM(x))2,  this 
amounts  to  minimization  of  E™i[w(^t  — xi )2  + (1  — w)(ti  — ePM(x))2]  with  respect 
to  t subject  to  (3.3).  Let 


g{t)  = J][u;(ti-xi)2  + (l-ii;)(ti-efM(x))2 

i= 1 


m 


-2Ai (t  - ePM(x))  - 2\2{Y,{U  - t)2  - (i?i(x)  + H2(x))}], 

X— 1 

where  Ai  and  A2  are  Lagrange  multipliers.  Differentiation  with  respect  to  U gives 


0 = — = 2w(ti  — Xi)  + 2(1  — w)(U  — ePM(x)) 
— 2Ai  — 2A2(fi  — t)  (1  — m-1). 
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Summing  over  i,  by  (i)  of  (3.3),  0 = 2i u(t  — x)  — 2Ai,  i.e.,  Ai  = w(t  — x).  Next 
writing  A2  = A2(l  — m_1),  again  by  (i)  of  (3.3), 

(1  - X'2)(U  -i)  = w(Xi  -x)  + {l-  w)(ePM(x ) - ePM{x))  = bu  1 < i < m.  (3.5) 

This  implies  (1  - A'2)2  E™i(*i  - t)2  = Z?=i  Then  by  (ii)  of  (3.3), 

m 

(l->.'2)2{H1(x)  + H2(x))  = '£t>l  (36) 

t=l 

Now  from  (3.5)  and  (3.6),  t*  — t = [ H\(x ) + fL^x)]1/2^^  fr2)_1/2&i,  be., 

m 

ti  = [Hi{x)  + H2(x)]iI\/ {Y'bl)-11*  + ePM(x), 

i= 1 

again  by  (i)  of  (3.3). 

Next  we  illustrates  an  application  of  the  above  result  for  the  one-parameter 
exponential  family. 

3.2.2  One-Parameter  Exponential  Family 

Let  Xi  denote  the  sample  average  of  a random  sample  of  size  n from  the 
one-parameter  exponential  family  with  mean  ip1  {(pi).  Thus  Xi  has  pdf 

f{xi\<pi)  = explnifaxi  - ip(<f>i))  + c(x,)],  1 < i < m. 


Consider  the  conjugate  prior  for  (pi  given  by 

n((pi\m,  A)  = exp[X((pim  - ip{<pi))  + g{m,  A)]. 
Then  the  population  mean  ip'{(pi ) has  posterior  expectation 

E[xp'{(pi)  |x<]  = (1  - B)xi  + Bm , 


where  B — 


rl>"(8i)/n 


r(8i)/n+r(8i)/X 


In  this  case  e i 


PM 


{x)  - ePM{x)  = (1  - B)(xi  - x), 


x = m 1 E™ 1 Xi,  and 
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bi(x)  = w(xi  - x)  + (1  - w)(ePM(x)  - ePM(x)) 
— {1  - (1  - w)B}(xi  — x). 


Also, 

m m 

Hi(x)  = J2v(0i  - 0\x)  = (n  + A)-1  Y,  E[rp"  {(f>i)\xi\{l  - m_1), 

i=l  t=l 

and 


H2{x)  = £(e,™(*)  - ePM(x))2  - (1  - B)2  5>;  - ^)2- 


«=i 


<=i 


Now  writing  o(x)  = [1  + Hi(x)/H2(x )]1/2,  the  CB  estimator  of  is  given  by 

(i-BKEr=i(^-^)2}1/2 


= a(x) 


{l-(l-w)BYY™i{.xi-x)2}1/2 

= a(x)(e[M (x)  — ePM{x))  + ePM(x) 


(1  — (1  — w)B){xi  — x)  + ePM(x) 


— a(x)ePM(x)  + (1  — a(x))ep  (x). 


This  is  same  as  the  expression  obtained  by  Ghosh  (1992)  assuming  squared  error 
loss.  In  a way,  this  demonstrates  the  loss  robustness  of  the  estimator  given  in  (3.4). 

For  the  special  case  of  the  natural  exponential  family  with  quadratic  variance 
functions  (NEF-QVF)  as  proposed  by  Morris  (1982,1983),  ip"{<j)i)  — u0  + Viip' {&)  + 
u2(ip' ((/>i))2 , where  u0,  Ui  and  u2  are  not  simultaneously  zeros.  Then, 

Hi(x)  — (n  + A — v2)~l[\  — m-1)  x 

m 

[mi>0  4-  mu i{(l  - B)x  + Bn}  + u2  ]T){(1  - B)xt  + Bn}2] 

i=l 

= (n  + A — u2)~l{m  — 1)  x 

m 

[u0  + Vi((l  - B)x  + Bn)  + u2((  1 - B)x  + Bn)2  + ^(1  - #)2^(z«  - s)2]. 

»=i 
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3.2.3  Bayes  Risk  of  the  Constrained  Bayes  Estimators 

We  now  consider  the  normal-normal  example  when  Xi\Gi  are  independent 
N(9i,  1)  and  9i  are  iid  N(h,t2).  In  this  case  tp(9i)  — \ 9?  so  that  (pi  — ip'(9i)  = Gi 
and  ip"(9i)  = 1.  Also,  B = (1  + r2)-1.  Now  Hi(X ) = (m  — 1)(1  — B)  and 
a(X)  = [1  + (1  - 5)_15_1]1/2,  where  S = - X)2/(m  — 1)-  The  posterior 

mean  of  6 is  ePM(X ) = (1  — B)X  + B/x lm  with  Bayes  risk  1 — B.  We  now  find  the 

~ CB 

Bayes  risk  of  0 in  the  following  theorem. 

~ CB 

Theorem  3.2  Under  the  loss  given  in  (3.1),  the  Bayes  risk  of  6 is  given  by 

w 4-  Oi(B)  + —[(1  - 2w)(l  — B)  - ai(B)  + a2(B)]  + 0(m~ 3/2), 
m 

where  ox(B)  = 2B"1(1  — B)  — 2B~1(1  - B)1/2-^  - (1  - w)B},  and  03(B)  = 
f (1  - B)V2{1  - (1  - w)B}. 

- CB 

Proof  of  Theorem  3.2  First  we  can  express  6 as  follows. 

eCB  = a(X)[(l  — B)X  + Bfj,lm]  + (1  — a(X))[(l  — B)X  + B/x]lm 
= a(X)(l  - B)(X  - Xlm)  + [(1  - B)X  + B/x] lm. 

And  then,  the  Bayes  risk  under  balanced  loss  functions  is 

e[l(9,  eCB )]  = m,-1  e[w\\x  - eCB\\2  + (i  - w)E\\e  - eCB\\2].  (3.7) 

But 

X-0CB  = X — (1  — B)a(X)(X  — Xlm)  — [(1  — B)X  + B/x]lm 
= [1  — (1  — B)a(X)](X  — X\m)  + B(X  — /x)lm. 

By  the  independence  of  X and  — A^)2,  one  gets 
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A /^D 

m-'E \\X  -6  ||2  = m~lE[{  1 - (1  - B)a{X)}2{m  - 1)5]  + Bm~l . 

Again, 

m-1£||0-0CS||2  = m-1E\\G-ePM(X)  + ePM(X)-eCB\\2 
= l-B  + m-lE\\ePM(X)-GCB\\2. 

But 

^ CB 

ePM(X)-9  = {l-B)X  + Bfilm-a{X)[{l-B)X  + Bfilm\ 
- (1  — a(X))[(l  — B)X  + B/j]lm 
= (l-a(X))(l-B)(X-Xlm). 

Hence, 

m~l  E\\ePM  (X)  — 0CB||2  = (1  — B)2{(m  — 1 )/m}E[(a(X)  — 1)25]. 
Combining  (3.7)-(3.10),  we  get 

A /°»  D 

E[L(G,G  )]  = (1  — w)(l  — B)  + wBrn,-1 

+ — %{l-(l-B)a(X)}25] 
m 

+ ”?-±E[(l-w)(l-B)2(a(X)-l)2S}. 
m 

Next  we  simplify 

ie[l  - (1  - B)a{X)]2  + (1  - w)(l  - B)2(a{X)  - l)2 
= (1  - B)2a2(X)  + w + (1  - to)(l  - B)2 
-2a(X)(l  - J5)[l  - (1  - w)B). 


(3.8) 


(3.9) 


(3.10) 


(3.11) 
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Now,  E[a2(X)S]  = E[{  1 + (1  - B^S^jS]  = B~ 1 + (1  - B)~l  = B~l{  1 - B)~\ 
Hence,  from  (3.11), 

B[{™(1  - (1  - B)a(X))2  + (1  - w)(l  - B)2{a{X)  - 1)2}5] 

= B~\  1 — B)  + B~l[w  + (1  - tn)(l  - B)2]  - 2(1  - B)[  1 - (1  - w)B]E[a{X)S] 
= B~l{  1 - B)  + B"1  - 2(1  - w)  + (1  - w)B 

-2(1  - B)[l  - (1  - w)B]E[a{X)S].  (3.12) 


B[a(X)S]  = (1  - B)-^2E[{{  1 - B)S2  + S}1/2]  = (1  - B)~1^2E[g(S)]  {say).  (3.13) 


Next 


By  the  Taylor  expansion, 


g{S)  = g(ES)  + (S-ES)g'(ES)  + -{S-ES)2g"(ES) 

+ hs-  ES )3  f\  1 - A)V'[AS  + (1  - X)ES]dX.  (3.14) 

2 Jo 


Note  that 


g(x ) = [x  + (1  - B)a:2]1/2, 
1 + 2(1  — B)x 


9 2[x  + (1  — B)#2]1/2’ 

1 - R M 4-  5>n  - RVrl2  1 


Noting  that  B(S)  — B 


5(B5)  - [B"1  + (1  - B)B-2]1'2  = B~\ 


(3.15) 


g"{ES)  = - 


1 B3 


4[B-1  + (1  - B)B~2]3/2  4 


(3.16) 
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Finally,  since  x > 0,  \g'"(x)\  < • Thus, 


\g'"[\S+{l-\)ES]\  < (l-fi)-5/2x 

r3 


_ [AS  + (1  - A )ES]~5/2  + -[AS  + (1  - A)£S]~3/2 
8 4 


< (1  -B) 


- Rl-5/2 


-(l-A)-5/2B5/2  + ^(l-A)-3/2B3/2 
.8  4 


(3-17) 


Hence,  from  (3.17),  Jq(1  — A)2|g'"[AS  + (1  — A)i£S]|dA  < oo. 

Also  E(S  - ES)2  - 2 B~2/(m  - 1),  E\S  - -ESI3  = 0(m~3/2).  Hence  combining 
(3.15)-(3.17),  one  gets 


E[s(S)]  = B-‘  + ^A(-^)  + 0(m-V2) 

= B-1  - + 0(m"3/2). 

4m 


(3.18) 


Thus,  from  (3.12)-(3.14)  and  (3.18),  one  gets  the  result. 

3.3  Empirical  Bayes  Estimators  and  Their  Bayes  Risks 
In  this  section  we  discuss  the  empirical  Bayes  estimators  under  balanced  loss 
function  and  also  the  Bayes  risk  of  the  such  estimators  valid  up  to  0(m-1)  given 
loss  functions. 

3.3.1  Empirical  Bayes  Estimators 

We  continue  with  the  normal-normal  scenario  where  as  before  Xi\9i  ~,nd 
N(6i,  1)  and  9i  N(g,  t2).  However,  this  time  g and  r2  are  both  unknown 
and  need  to  be  estimated  from  the  marginal  distributions  of  the  AVs.  Marginally, 
Xi  are  iid  N(g,  B-1),  where  B = (1  + r2)-1.  Based  on  these  marginals,  X — 
m~l  YhLi  Xi,  and  S = X)™  i(ATi  — X)2/(m  — 1)  is  complete  sufficient  for  (g,  B ). 
Following  Morris  (1981),  we  estimate  g and  B respectively  by  g = X and  B = 


m*n(m^f’  (wT-Rg)-  We  now  have  *he  estimator  of  9 from  (3.2)  as 
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A R R A A — 

0 = wX  + (1  - w)[(l  - B)X  + J3Xlm] 

= [1  - (1  - w)B\X  + (1  - w)BXlm. 

3.3.2  Bayes  Risk  of  the  Empirical  Bayes  Estimators 

We  now  find  the  the  Bayes  risk  of  the  EB  estimator  correct  to  0(m~l)  under 
the  loss  (3.1). 

~ EB 

Thorem  3.3  Under  the  loss  given  in  (3.1),  the  Bayes  risk  of  0 is  given  by 

(1  — w)(l  — (1  — w)B)  + — — + o(m-1). 

m 

Proof  of  Theorem  3.3  To  this  end,  first  let  B = We  begin  with 

^ EB  * a.  _ 

X -e  = X - [1  - (1  - w)B]X  - (1  - w)BX  1 
= (1  -w)B{X  -XI) 

= {l-w)[k{X -X1)  + {B  - B){X  - XI)}. 

Hence, 

A to »d  £ A A 

E[ \\X-e  ||2]  - (1  -w)2E[B2(m-  1)5]  + (1  -w)2E[{B-  B)2{m-  1)5] 

+ 2{\-w)2E[B(B  - B){m-l)S]\  (3.19) 

E[fr(m  - 1)5]  = = (™  - 3 )B;  (3.20) 

E[(B  - ’Bf(m  - 1)S]  = - bf(m  - 1)S7, 

< £1/2[(^|  - £)4(m  - 1)2S2]  x 
P1/2[|  > 1], 


(3.21) 


42 


But  by  the  Q-inequalty  ( a + 6)1+<s  < 2<*(a1+l5  + b1+s ) for  a > 0,  b > 0 and  6 > 0, 


E[(— — ^ - i?)4(m  - 1)252]  < 8E[(— — - + B4)(m  — 1)2521 

771  — 1 777—1 

r(m  — 3)4(m  + 1)B-2  (m  — 3)4jB2 

= 8[ 7 H 


(m  — l)3 


(m  — 3)(m  — 5; 


= 0{m2), 


(3.22) 


while, 

fYl  7 

= P(B(m  — 1)5  < B(m  — 1)) 

= p{x2m-i  ~ (m-  1)  < (m-  1)(B-  1)) 

< — (m  — 1)1  > (m  — 1)(1  — B)) 

= 0(m~r),  (3.23) 


for  any  arbitrary  r > 0.  Choosing  r > 4,  one  gets  from  (3.21)-(3.23), 

£'[(B  — B)2(m  — 1)5]  = o(m_1).  (3-24) 

Next  by  the  Schwarz  inequality,  (3.20)  and  (3.24), 

E[B{B-B)(m-l)S\  < E1/2[B2{m  - 1)S]E1/2[(B  - B)2(m  - 1)S] 

= 0(m1/2_r/2)  = o(l)  for  r>  2.  (3.25) 


Hence,  from  (3.19),  (3.20),  (3.24)  and  (3.25), 


m-‘£[||X  - eBB\n  = + o(m_1). 

m 


(3.26) 


Next  we  calculate 
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E[\\0 -eEB\\*}  = E\\0-ePM(X)  + eFM{X)-0EB\\ 2 

^ PR 

= m(l  - B)  + E\\ePM {X)  - 9 ||2.  (3.27) 

Also, 

A pp  A A 

ePM(X)-9  = (l-B)X  + Bfjtlm-[l-(l-w)B]X-{l-w)BXlm 
= [(1  - w)B  - B\X  - [(1  - w)B  - B}Xlm  - B{X  - /z)lm 
= [(l-w)B-B](X-Xlm)-B(X-n)lm. 

Hence,  by  the  independence  of  X and  X — Xlm, 

E\\ePM(X)  - 0EB\\‘2  = f?[{(l  - w)B  - B}2(rn  - 1)5]  + B (3.28) 

Also, 

E[{(l-w)B  - B}2{m-l)S]  = E[{{l-w)b-B}2{m-l)S] 

+ (1  — w)2E[(B  — h)2{m  — 1)5] 

+ 2(1  — w)  x 

E[((l  - w)h  - B){B  -b){m-  1)5]. (3.29) 


Next 


£[{(1  - w)B  - B}2{m  - 1)5]  - (1  - w)2E[B2{m  - 1)5]  + E[B2{m  - 1)5] 

- 2(1  — w)BE[B(m  — 1)5] 

— 2(1  — w)(m  — 3)B  + (m  — 1)B 


= (1  — w)2(m  — 3 )B 
— 2(1  — w)(m  — 3 )B  + (m  — 1)B 
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= (m  — \)B  — (1  — w2)(m  — 3)B 
= [2  + (to  - 3)w2]B.  (3.30) 

By  (3.24),  (3.30)  and  the  Schwarz  inequality,  for  any  r > 3/2, 

£[|(1  — w)b  — B\\B  — b\(m  — 1)5]  < £1/2[{(1  - w)B  - B}2{m  - 1)5]  x 

El/2[{B  - B)2{m-  1)5] 

= [(2  + (to  - 3 )w2)B]1'2)0{m-r) 

— 0(m1/2)o(m~1)  = o(l).  (3.31) 


Now  by  (3.28),  (3.29),  (3.31)  and  (3.24),  one  gets 

eb  2 B (2  + (m  — 3)w2)B 


m~1E\\ePM  (X)  — 6 
Combining  (3.26),  (3.27)  and  (3.32), 


m 


m 


+ o(m  x). 


(3.32) 


A pp  Q D 

E[L(0,  0 )]  = u;(l  — w)2[B h o(m_1)l 

m 


+ (1  — u/)[l  — B H 1- 


B (2  + {m-3)w2)B 


m 


— (1  — w)(l  — (1  — w)B ) + 


m 

3(1  — w)2B 

m, 


+ o(m  *)] 


+ o(m  *).  (3.33) 


Thus,  from  (3.33),  one  gets  the  result. 

To  estimate  the  MSE  expression  given  in  (3.33),  we  need  only  to  find  E(B). 
With  the  same  argument  as  before 


E[B\  = E[B-B]  + E[B] 


m — 1 


(m  — !)£> 


(3.34) 


_r  m — 3 , „ 

^ (to  — 1)5  = S; 


(3.35) 
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£ El/2Ksbr  “ ~b?\p1'\s  < i).  (3.36) 

II L X J Mi  1 


But, 


£[(^  _ kn  < 4 E[^=l  + i>]  = 4(^  + (=LZ^!)  = 0(1).  (3.37) 


m — 1 m — 1 

Hence,  from  (3.36),  (3.37)  and  (3.23), 


m — 1 


m — 5 


£[£  - 5]  = o(m_1). 


(3.38) 


Now  by  (3.34),  (3.35)  and  (3.38),  one  gets 


E[B]  = B + o{m~l). 


Hence, 


£'[(1  — ra)(l  — (1  — w)B)  + 


3(1  -w)2B 


m 


= [(1  - u;)(l  - (1  - w)B)  + 


3(1  - w)2B 


m 


+ o(m  ). 


3.4  Constrained  Empirical  Bayes  Estimators 
Constrained  EB  estimators  are  obtained  by  substituting  B for  B and  X for  fi 
in  constrained  Bayes  estimators.  Accordingly, 

-*>  CEB  a A _ _ 

9 — (Ieb[{  1 — B)X  + BX  lm]  + (1  — (ieb)X  lm, 

where  cieb  = [1  -h  (1  — £)-15_1]1//2.  Now  under  the  loss  (3.1),  the  the  Bayes  risk  of 
the  constrained  EB  estimator  is 

E[L(9,  0CEB )]  = m-x[wE\\X  - 0°EB ||2  + (1  - w)E\\G  - e°EB ||2]. 

We  now  find  the  the  Bayes  risk  of  the  constrained  EB  estimator  correct  to  0(m-1) 
under  the  loss  (3.1). 
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Thorem  3.4  Under  the  loss  given  in  (3.1),  the  Bayes  risk  of  0 is  given  by 
w + ci(B)  + —[3  — 2wB  — Ci(B)  + 2(1  — (1  - w)B)c2{B)]  + 0(m~ 3/2), 

TTl 

where  Ci(B)  = 2[£1(1  — B — (1  — B )x/2)  + (1  — iu)(l  — S)1/2  and  c2(B ) = 

1 - (2  - B){  1 - B)-1'2  + \B{  1 - fi)-3/2. 

Proof  of  Theorem  3.4  First  we  write 

\\X-0CEB\\2  = ||[l-a£B(l-S)](X-*lm)||2 
= [1  - aBB(l  - B)]2(m  - 1)5 
= [1  + a|B(l  - B)2  - 2aBB(l  - B)](m-  1)5 
= [1  + (1  - B )2  + (1  - 5)S_1  - 2aBB(l  - S)](m  - 1)5. 

Accordingly, 

E\\X-0CBB\\2  = (m  — 1)5_1  + £[(1  — B)2(m  — 1)5]  + £[(1  — B)(m  — 1)] 

— 2E[(1  — fi)aEB(m  — 1)5] 

Noting  that  B = j^g, 

£[(l-£)2(m-l)5]  = £'[(1  — h + h — B)2(m  — 1)5] 

- £[(1  - h)2(m  - 1)5]  + £[(£  - B)2{m  - 1)5] 

+ 2£[(1  — B)(B  — B)(m  — 1)5].  (3.39) 

We  calculate 

£[(1  — B)2{m  — 1)5]  = £_1(m  — 1)  — 2(m  — 3)  + (to  — 3)B 

= 2 B-1  + (m-3)B-1{l-  B)2-,  (3.40) 

Now  by  (3.20),  (3.21),  (3.40)  and  Schwarz  inequality  for  the  rightmost  term  of 
(3.39),  one  gets 
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£[(1  - B)2{m  - 1)5]  = 2 B~l  + (m  - 3)5_1(1  - B)2  + c^m-1). 

Also, 

£[(l-£)(m-l)]  = £[(1  — h)(m  — 1)  + (^  — B)(m  — 1)] 

= (m  — 1)(1  — 5)  + o(m-1). 

Thus,  from  (3.40)  and  (3.42) 

A r>C'p 

E \\X-0  ||2  = (m  — 1).B-1  + 2B_1  + (m  — 3)5_1(1  — B)2  + (m  — 1)(1 

— 2£'[(1  — B)a£s(m  — 1)5]  + o(m_1). 

Next  we  find 

E\\e-eCEB\\2  = E\\e-ePM{X)  + ePM(X)-6CEB\\2 
= m{\- B)+E\\ePM{X)-6CEB\\2. 

We  now  write 

A (~*  Tp  D A A 

e — ePM(X)  = aEB[{l-B)X  + BXlm]  + {l-aEB)Xlm 
- {l-B)X-Bnlm 

= [aEB(  1 - B)  - (1  - B)](X  - Xlm)  + B(X  - 
Once  again,  by  the  independence  of  X — Xlm  and  X — n, 

A^tpp  A 

E\\G  - ePM(X)||2  - B + E[{aEB{  1 - B)  - (1  - B)}2(m  - 1)5]. 
Now  from  (3.41),  (3.42)  and 


(3.41) 


(3.42) 

- B ) 

(3.43) 


E[{aEB(  1 - B)  - (1  - B)}2(m  - 1)5] 

= E[{a2B B(1  - B)2  + (1  - B)2  - 2(1  - B)aEB(  1 - B)}(m  - 1)5] 


= £[(1  - B)\m  - 1)5]  + E[{  1 - B){m  - 1)]  + E[(  1 - B)2(m  - 1)5] 
-2(1  - B)E[aEB{  1 - B)(m  - 1)5], 
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one  gets 

E\\eCEB  - e\\2  = m(l  — B)  + B + 2B~l  + (m  — 3)£-1(l  — B)2 
+ B)  + {m~l){l- B)2B~l 

— 2(1  — B)E[aEB(l  — B)(m  — l)S]  + 0(171^).  (3.44) 

Now  by  (3.43)  and  (3.44),  the  MSE  of  CEB  can  be  expressed  as 

E[L(0,  eCEB))  = m-1[wE\\x-dCEB\\2  + (i-w)E\\e-eCEB\\2} 

= W + 2B~1(l  -B)  + —[3  -2w-  2B~1(1  - B)  + 2(1  - B)] 

m 

- —{1  — (1  - w)B}E[aEB(l  — B)(m  — 1)S]  + 0(171^).  (3.45) 

771 

But 

E[aEB{l-B)S]  = £[(1  - B)252  + (1  - B)5]1/2 

= E[{(1  - B)252  + (1  - B)Sy'2I[Uk]] 

+ E({(l-B)2S2  + (l-B)S}1'2I[.=k]] 

But 

B[{(l-^)252  + (l-^)5}1/2]  = £[{(1  - b)2S2  + (1  - b)S}^2I[s>i] 

+ £[{(1  - b)2S2  + (1  - j^)5}1//2/[s<i] 

= E({(l-b)2S2  + (l-b)S}1'2I[s>i} 

+ o(m_1). 
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Prom  the  above  result, 

£[(1  - B)2S2  + (1  - B)S}^2  = E[{(1  - b)2S2  + (1  - i^S}1/2]  + oim-1).  (3.46) 
Again, 


E[(l  - £)S{1  + (1  - ^)5’}]1/2  = E[(S-  Vn— -)(1  + S-  -)]1/2 

TTt  1 771  1 

m — 1 (m  — l)2 
= E[h(S)}.  (say) 


Writing  for  x > 1,  m large,  h(x)  = [x2  — — 2^.^ I ]1//2, 


m — 
m — 


2 (m  - 3) 
(m  — l)2 


]-1/2(2a;  - 


m — 5^ 
m — 1 ’ 


*'(.)  = -i[x2-^x-^|rs/2(2x-^)2; 

4 m - 1 (m  - l)2  m — 1 


_L  rr2  _ ™ ^ _ 2(m  3)]-l/2 

m — 1 (m  - l)2 


= 1[J2  m~5J.  2(yn.  3)  i — 3/2 


m — 1 (m  — 1)2 


h'"(x)  = l(x2  - ^^-x  - 2}m  3l]~5/2(2x  - 

8 m—1  (m  — l)2  m—1' 


By  the  Taylor  expansion, 


h(S)  = h(ES)  + (5  - ES)h'(ES)  + -(S  - ES)2h"(ES) 

z 


+ 


l(S-  ES)3  f\l  - \)2h"'[XS  + (1  - X)ES]dX. 
2 Jo 


Noting  that  ( S - ^f)(S  + ^ S , for  S > 1 and  P(S  < 1)  = 0(m~r)  for 

any  arbitrary  r > 0 from  (3.23),  it  follows  now  from  (3.46)  that 


h'"[XS  + (1  - X)ES]  < |h'"[A5  + (1  - A)^5]|/[S>i]  + 0(m~r) 
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< l {-=~r(\S  + (1  - A)£5}-5/22{A5  + (1  - X)ES}I[s>1] 

O Tfl  — 1 


< 


< 


2 (m  — 1) 

3 


[XS  + (1  - \)ES]~3/2I[s>i] 
[(1  - A)BS]"3/2. 


2 (m  — 1) 

Since  /o(l  - A)2(l  — X)~3^dX  < oo  and  E\S  - BS'|3  = 0(m-3/2),  choosing  r > 3/2, 
it  follows  that 

E[(S  - ES )3  [\l  - X)2h"'[XS  + (1  - A)BS]dA]  = 0(m"3/2). 

Jo 

Also  since  E(S)  = B-1,  it  follows  from 

E[h(S)}  = (B-1  - + -^-)i/2 

m - 1 m — 1 

- ^-l)-^(B~l  + ^-)-3/2  + 0(m-3/2) 

— 1)  m — 1 m — 1 


4(m  — 1) 

/I  — 2 \l/2/^  2 \i/2 


B 


■ (L_?  + -J_)-s/2(I  + — ?_)-*/»  + 0(m-V2) 


4(m  — 1)B2  B m — 1 B m — 1' 


(1  - B)1/2 


[1  + 


B 


+ 


B 


B L~  ' (m  — 1)(1  — B)  m — 1J 
B3(l  - B)-3/2 


+ 0(m  3/2) 

= (1  - B)1/2B-1  + —[(2  - B)(l  - B)-1/2  - i(l  - B)-3/2B] 

771  i 


4(m  — 1)B2 
1 - Bfl' 

+ 0(m_3/2) 


(3-47) 


Now  combining  (3.45)  and  (3.47),  one  gets  the  result. 


CHAPTER  4 

RANDOM  EFFECTS  NORMAL  ANOVA  MODEL  WITH  BALANCED  LOSS 

FUNCTION 

4.1  Introduction 

In  Chapter  3 of  this  dissertation,  we  developed  the  general  algorithm  for 
finding  constrained  Bayes  and  empirical  Bayes  estimators  under  balanced  loss 
functions.  In  particular,  for  the  normal-normal  example,  we  found  the  Bayes  risks 
of  the  empirical  Bayes  estimators  correct  up  to  order  0(m-1)  (m  being  the  number 
of  cells  in  ANOVA  problem)  assuming  the  sample  variances  to  be  known,  but  the 
prior  means  and  variances  to  be  unknown. 

In  the  present  chapter,  we  derive  constrained  empirical  Bayes  estimators  in 
the  normal-normal  set  up  when  the  sample  variances  are  also  unknown.  First  in 
Section  2,  we  find  the  constrained  Bayes  estimators  and  the  Bayes  risks  of  these 
estimators  correct  up  to  order  0(m_1)  under  the  present  set  up.  The  results  are 
slight  extensions  of  those  in  Section  3.2.  Next  in  Section  3,  we  find  the  constrained 
empirical  Bayes  estimators  and  the  Bayes  risks  of  these  estimators  also  correct  up 
to  0(m_1)  under  the  present  set  up. 

4.2  Constrained  Bayes  Estimators  in  the  Balanced  ANOVA  Model 

In  this  section  we  develop  the  constrained  Bayes  estimators  in  the  balanced 
normal  ANOVA  model  under  balanced  loss  function  and  find  also  the  Bayes  risk  of 
the  such  estimators  valid  up  to  0(m-1). 

4.2.1  Constrained  Bayes  Estimators 

Consider  the  balanced  normal  ANOVA  model  with  = di  + e^  and  0*  = //-t-a, 
(j  = 1, ...,  k;  i = 1,  ...m).  Here  the  a*  and  the  e„  are  mutually  independent  with 
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Oii  N( 0,  r2)  and  ~,,rf  X(0,  <r2).  Alternatively,  in  a Bayesian  framework,  this 
amounts  to  saying  that  Yij\0i  ~nd  N(9i,a 2),  i = 1,  ...m  and  ~*,d  Af(//,  r2). 

Minimal  sufficiency  consideration  allows  us  to  restrict  to  (Xi, ...,  Xm,  SSW), 
where  X,  = | £j=1  and  SSW  = £”i  Ej=i(YH  ~ ^)2-  We  may  note  that 

marginally  Xi, ...,  Xm  and  SSW  are  mutually  independent  with  X*  X(M,r2  + 
a2/A:),  i.e.,  N(n,a2/(kB)),  where  B = = ^75  and  SSW  ~ ^X^k-iy 

From  the  results  of  the  previous  chapter,  the  constrained  Bayes  estimator  of 
6 = (0i,...,0m)T  is  given  by 

A D 

B = a(X)(l  -B)(X-  Xlm)  + {(1  - B)X  + B/x}lm, 


where  X = (Xi, ...,  Xm)T , X = m 1 IC^X*,  and  lm  is  an  m-component  column 
vector  with  each  element  equal  to  1.  Also  a2(X)  = 1 + where  Hx(X)  = 

(m  - 1)(1  - B)a2/k  and  Ba(X)  = (1  - - X)2  = (1  - B)2{SSB/k), 

(say).  Then,  on  simplification, 


a2(X)  = 1 + 


(1  — B)MSB' 


where  MSB  = SSB/(m  — 1). 

4.2.2  Bayes  Risk  of  Constrained  Bayes  Estimators 

The  calculation  of  the  Bayes  risk  of  the  CB  estimator  is  analogous  to  that  in 
the  previous  chapter  with  minor  modifications.  For  completeness,  we  outline  the 
major  steps.  For  the  balanced  loss  as  introduced  in  Chapter  3,  the  Bayes  risk  of 

~ CB 

0 under  the  given  model  is 


r(pCB)  = m~l{wE\\X  - tfB ||2  + (1  - w)E\\QCB  - 0||2},  (4.1) 


where  XT  — {Xi,X2,  ....,Xm).  We  now  find  the  Bayes  risk  of  9 in  the  following 


theorem. 
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Theorem  4.1  Under  the  loss  given  in  (4.1),  the  Bayes  risk  of  9 is  given  by 

2 2 

(1  - u>)(l  -B)  + ya i(5)  + ^—[a2{B)  - a^B)]  + o(m-1), 

where  a^B)  = B~l{\ - (1  - w)B}[2  - B - 2(1  - B)1/2]  and  a2{B)  = § (1  - B)1/2(l  - 
(1  — w)B). 

Proof  of  Theorem  4.1  As  before,  let  ePM  = (1  — B)X  + Bn lm.  Then 

m-lE\\6CB  -0\\2  = m-lE\\eCB-ePM  + ePM-G\\2 

= \-B  + mrlE\\ePM -9CB\\2.  (4.2) 

But 

ePM-0CB  = (1  - B)(X  - Xlm)  - a(X)(l  - B)(X  - Xlm) 

= (1  — a(X))(l  — B)(X  — Xlm).  (4.3) 

So  by  (4.3),  one  gets 

m~xE\\ePM  - 0CB\\ 2 = (1  - Bf^EUl  - a(X))2MSB\.  (4.4) 

km 

Next 

A /■"»  JD 

X-9  =(l-a(X)(l-B))(X-Xlm)  + B(X-n)lm.  (4.5) 

Hence,  by  (4.5),  one  gets 

^ p 777  1 

m~lE\\X  — 9 ||2  = ra_12?[(l  - a(X)(l  - B))2 — - — MSB] 

K 

4-  B2  (km,)-1  (a2  + kr2) 

- ^[(l-aW(l-B)M  + f^.  (4.6, 


Combining  the  results  from  (4.2),  (4.4)  and  (4.6), 
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E{L(0,i)CB)]  = (1  - rc)(l  - B)  + ^ 

+ ! -£T[(«j(1  - a(X)(l  - B)fMSB] 

km 

+ ^7— ^M(l  — tu)(l  — B)2(l  — a(X))2MSB].  (4.7) 

km 


On  simplification, 


w{l  - (1  - B)a(X)}2  + (1  - to)(l  - Bf{  1 - a(X))2 
= (1  - B)V(X)  - 2(1  - B)(l  - (1  - w)B)a{X) 

+{«;  + (1  - u;)(l  - B)2}.  (4.8) 


We  now  calculate 


E[a2(X)MSB } = £[(1  + 


(1  - B)MSB 


)MSB)\ 


= E[MSB  + 


1 - B ‘ 
~2 


_2  _2 

a cr 

1?  + 1-5 
= <t25_1(1  — B)-1. 


(4.9) 


Hence,  from  (4.8)  and  (4.9), 

E[{w{  1 - (1  - S)a(X)}2  + (1  - w)(l  - 5)2(1  - a(X))2}MSB] 
= B~\l  - B)a2  + {w  + (i-  u»)(l  - S)2}S-V2 
-2(1  - B)(l  - (1  - w)B)E[a{X)MSB) 

= B_1(l  - B)a2  + B~la2  - 2(1  - w)a2  + (1  - w)Ba2 
-2(1  - B)(l  - (1  - w)B)E[a(X)MSB ] 

= a2(2  — B)B~1[l  — (1  — w)B] 
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-2(1  - B)(  1 - (1  - w)B)E[a(X)MSB],  (4.10) 

Next  we  find 

E{a(X)MSB]  = g[(l  + b)MSB)1'*MSB)  1 

= (1  - B)-^2E[(  1 - B)(MSB)2  + a2MSB]1'2 

= (1  -B)-^2E\g(MSB)\  (say),  (4.11) 

where  g(x)  = [(1  — B)x2  + a2x ]1//2.  By  Taylor  expansion,  noting  that  E(MSB)  — 
o2/B, 

g(MSB)  = g(a2/B)  + (MSB  - a2 /B)g'(a2 /B) + \(MSB  - a2 / B)2 g" (a2 / B) 

+ l(MSB  - a2  jB)3  [\l  - X)2g"'[X(MSB)  + (1  - A)(<r2/S)]dA(4.12) 
2 J o 

Now 

g'(x)  = ^{(1  - B)x2  + <72x}~1/2{ 2(1  - S)x  + a2}; 

g"(x)  = — ^{(1  — B)x2  + <t2x}_3//2{2(1  — B)x  + a2}2 
+ (1  - B){(1  - B)x2  + a2x}-^2 
= -^{(l-B)x2  + a2x}-3'2; 

g'"(x)  = ^{(1  - B)x2  + a2x}-5'2{ 2(1  - B)x  + a2}. 

Hence, 

g(a2/B)  = [(1  — B)(B~1a2)2  + B-1ct4]1/2 
= [5_1(t4{(1  - B)B~l  + 1}]1/2 

= 5~V; 


(4.13) 


Finally,  since  x > 0, 


Thus, 


\9'"(x)  | < 

< 


3<t4(ct2  + 2x ) 
8x5/2(j5(l  - B) 5/2 
3a4  (cr2  + 2x) 
8x5/2cr5 
3(<t2  + 2x) 

8 era;5/2 


|/'[AX  + (1-A)EX]|  < ^[AA  + (l-A)£X]-5/2 

8 

+-^-[ax  + (i  - a)£X]-3/2 

4(j 

< ^(l-A)-5/2B5/2a-5 
8 

+ A(l_A)-3/2B3/2(T-3 
4(7 

Hence,  /^(l  - A)V"[AA:  + (1  - A)£X]|dA  < oo.  Also  we  know  that  E\MSB  - 
a2/5|3  = 0(m-3/2)  and 


9 R-2-.4 

£(MSB  - <j2/B)2  = 


(4.15) 


Combining  the  results  from  (4.12)  to  (4.15), 


E[a(MSB)]  = B-'<72  - + 0(m-3'2) 

o_2 

= 5-V-^  + 0(m-3/2). 

4m 


(4.16) 


Thus,  by  (4.10),  (4.11)  and  (4.16), 

Eimf8)]  = (i-«o(i  -b)+^+ 

+ (m  - 1)<7a  p - - (1  - w)B) 

km 

- 2(--.~ilcrI(i  _ b)V2(1  _ (i  _ w)B)(B~1  ~^~  + 0(m-*l2)) 
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= (l-w)(l-B) 

2 

+ ^-B-1{1  — (1  — w)B}[2  — B — 2(1  — B)1/2] 
k 

- 7— -[B_1{1  — (1  — w)B}[2  - B - 2(1  — S)1/2] 
km 

+ - (1  - «,)£}]  + o(m-‘) 

= (1  - w)(l  - B)  + ya i(B)  + ^ [02(B)  - fli(B)] 

4-  o(m-1), 

where  ax(B)  = B~1{1  - (1  - w)B}[2-  B - 2(1  - B)1/2]  and  03(B)  = f(l  -B)1/2(l- 
(1  — w)B). 

The  following  section  develops  comstrained  EB  estimators  and  finds  their 
Bayes  risks  order  up  to  0(m_1). 

4.3  Constrained  Empirical  Bayes  Estimators  in  the  Balanced  ANOVA  Model 
The  constrained  empirical  Bayes  (EB)  estimator  of  6 is  given  by 

A pPD  A _ _ 

e = aEB(X)(l  - B)(X  - Xlm)  + Xlm, 


after  substitution  of  //  by  X,  B by  B and  a2  by  MSW . Here  B = min{ } 
and  cleb{X)  = 1 + now  ^ayes  °f  ^ in  following 

theorem. 

- CEB 

Thorem  4.2  Under  the  loss  given  in  (4.1),  the  Bayes  risk  of  6 in  the  bal- 
anced ANOVA  model  is  given  by 
2 2 

(1  - w)(l  - B)  + yOi(B)  + jjy [(1  - ™)B  - ai(B)  + a2(B)  + a3(B)]  + o(m-1), 

where  ax(B)  = (l-(l-u;)B)B-1(2-B+2(l-B)1/2],  03(B)  = 2(2-B)(l-2(l-B)1/2 
and  o3(B)  = ^(f  - 

Proof  of  Theorem  4.2  We  begin  calculating 

\\X-eCEB\\*  = (l-aEB(X)(l-B))(X-Xlm)\\2 
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= [(l-aEB(X)(l-B))2T^MSB] 

- 2(m~  l)E[aEB{X){l  - B)MSB\ 

= r^^[MSB  + {\-  B)2MSB  + {1-  B)MSW] 
k 

- 2(m  ~ ^E[aBB(X){  1 - B)MSB}. 

Hence, 

m~lE\\X  -eCEB\\2  = ^£[(1  - 5)2M5B] 

«m  km 

+ B)MSW] 

km 

- 2(??  ~ ^E[aEB{x){l  - B)MSB\.  (4.17) 


Define  B = • Fifst  we  calculate  2£[(1  — S)2M5B].  Noting  that  MSB 

and  MSW  are  independently  distributed  with  MSB  ~ (a2/B)Xm- i/(m  — 1)  and 


M5H7  ~ cr2x^i(fc_1)/m(fc  - 1),  one  gets 


B[(l  - £)2MSB]  = B[MSB-2™ — \mSW  + ^ ] 


m — 1 


(m  — l)2  MSB 


= o'1  IB-  2 


m — 3 2 (m  — 3)2  m(fc  — 1)  + 2 m — 1 


-<T'  + 


m — 1 (m  — l)2  m(k  — 1)  m — 3 


5 


— 1 m — 1 


+0(m-2)]. 


B m 
— 2\ 


m(fc  — 1) 


(4.18) 


Next  we  show  that 

Lemma  4.1  For  any  arbitrary  r > 0, 


E[(B  - BfMSB ] = o(m~T). 
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Proof  of  Lemma  4.1 


* . 777  Q 

E[(B-B)2MSB\  = E[{ -)2(1  — 

m — 1 


MSW 

MSB 


)2Imsw>msb\ 


< £1/2(1  - ^w)*P1/2{MSW  > MSB ) 

MSB 

= E'/2(1  “ > B-1).  (A) 


But 


P1/2(Fm(k-l),m-l  > -B-1)  = P^^2 (Pm(k—l),m—l 


771  — 1 


> B~l  - 


m — 1 


< 


m — 3 m — 3 

(B-1-l-2/(m-3))2r 


) 


We  next  show  that 


-{m-  1 )/(m  - 3)]2r  = 0(m  r)  as  m ->  oo.  (B) 


JV[0,  Diag(2a4 / B2 , 2<r4)], 


In  order  to  prove  ( B ),  we  begin  with  the  result 

MSB-a2/B ' 

MSW -a2 

which  follows  as  a consequence  of  the  central  limit  theorem  and  the  independence 
of  MSB  and  MSW.  Hence,  by  the  Delta  method, 


This  shows  that  V^[^m(fc-i),m-i  - 1]  = Op(l),  since  MSW/MSB  ~ 
Further,  for  any  r > 1, 


S'UPm>16r+l^'  E [-^r7i(fc — l),m — 1 1]  — ®^Pm>16r+l  ^ B 


ulm  - u, 


2m 


4 r 


u, 


2m 


where  U\m  and  [/2m  are  independent  with  t/Xm  ~ Xm(k- i)/m(k  ~ 1)  and  U^m  ~ 
~ !)•  By  the  Schwarz  inequality, 
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E[U^(Ulm-U2m)]4T  < EW{U£)E'l*[{Vlm  - 1)  - (U2m  - l)]8r 

- 0(l)0(m~2r), 

since  by  c^-inequality,  for  r > 1, 

E[(Ulm  - 1)  - (U2m  - l)]8r  < 2Sr-1E[(Ulm  - l)8r  - (U2m  - l)8r]  = 0(m-4r), 

and  for  m > 16r  + 1,  £'([/^r)  = 0(1).  Thus,  m2r[Fm(fc_1)im_1  — l]4r  is  uniformly 
integrable  in  m > 16r  + 1.  Hence,  the  left  hand  side  of  ( B ) is  0(m-r)  for  r > 0. 
This  implies  that  the  left  hand  side  of  (A)  equals  to  0(l)0(m~r)  = 0(m~r). 

In  view  of  the  above  lemma,  it  follows  that 

E[\B  - B\{1-  B)MSB]  < E[\B-B\MSB } 

< E^2[(B  - B)2E1/2{MSB) 

--  o(m_r),  (4-19) 

for  an  arbitrary  r > 0.  Thus,  from  (4.18)  and  (4.19), 

E[(l  - + -4-  - (—  - 2 )B] 

B m—  1 m—  1 m(k  — 1) 

+ o(m_1).  (4-20) 


Next  we  find 


E[{\-  B)MSW]  = E[(\- B)MSW + (B  - B)MSW] 

= E[{1-  B)MSW]  + o(m-r),  (4.21) 


for  an  arbitrary  r > 0.  Also 


E[{1-  B)MSW]  = E[(l 


m - 3 MSW 
m — 1 MSB 


)MSW] 


— a — 


m-3  AMSWf 


m 


-i* 


MSB 
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9 9 m — 3 m(k  — 1)  + 2 m — 1 _ 

- <jz  — a1 v - — -B 


= cr2[l  — B + 


m — 1 m(k  — 1)  m — 3 
2 


m(k  — 1) 
2 B , 


m(fc  — 1) 

Combining  the  results  from  (4.17),  (4.20),  (4.21)  and  (4.22),  we  get 


(4.22) 


m-lE\\X-eCBB\\2 


(m  " Vv 


km 


(m  — 1)  2r(l-S)2  4 . 2 

+ ~a' P — ~ ( 


km 


B 


+ 


(ro-1b2[l  -B  + 


m — 1 m — 1 m(k  — 1) 
2 B 


)B] 


km 
2 (m  — 1) 


;] 


km 


m(k  — 1)J 
E[aBB{X){  1 - B)MSB]  + o^1) 
(1  - BY 


+ 5^  + 


B 

(1  ~ Bf 
B 


+ l-B}  + 4-2B  + 


4 B 


k{k-\Y 


2 (m  — 1) 
km 


E[aBB(X)(  1 - £)MSB]  + 0(771 —1) 


4E 


= y<2  - S)B_1  + ^l<2  - B)<2  - B_‘)  + k(k  _ !)J 


2(777  — 1) 

km 


E[aBB(X)(  1 - B)MSB]  + o^"1). 


(4.23) 


Next  we  find 


m~1E\\0CEB  — 9\\2  = m~1E\\0CEB  — ePM  + ePM  — 0||2 

= (1  — S)  + 77i_1£'||eFM  — 6CEB\\2.  (4.24) 


But 


Ar'PD  A 

e — ePM  — aBB(X){l-B)(X-Xlm)-{l-B)X-BfjLlm 
= [aEB{X)(l  - B)  - (1  - B)](X  - Xlm) 

+ B(X  — fi)  lm. 
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So  by  the  independence  of  X and  X — Xlm, 


m 


~xE\\QCEB  — ePM\ 


+ 


Bo 2 
km 

^^E[{aEB(X)(  1 — £)  — (1  - B)}2MSB\. 


Now 


m — 1 


£[Wb(*)(1  - B - (1  - B)}2MSB] 


km 

= ^^E[{a%B(X)(  1 - B)2  + (1  - B)2}MSB] 

2(m  — 1) 

km 

= tHlZ1e[(1  - BfMSB  + (1  - B)MSW  + (1  - B)2MSB] 
km 

2 (m  — 1) 


-B[aBB(*)(l  - B)(l  - B)MSB] 


km 


-E[aEB{X)(l  - B)(l  - B)MSB] 


(m  — 1)  2r(l  — B)2  4 

-a  [ + 


km  B 

o2[  1 - B + 


(: 


(m  - 1)  2 


km 

2 (to  — 1) 


m — 1 to  — 1 m(A;  — 1) 
2B  | (m-l)j2(l-B)2 


)*] 


m(k  — 1)J  ' km 
E[aEB(X){  1 - B)(l  - B)MSB] 


B 


2 (m  — 1) 
km 


E[aEB(X){  1 - B){  1 - B)MSB]  + o(ro_I). 


Hence,  (4.24)  can  be  expressed  as 


m-1£||0CBS-6l||2  = (1-B)  + 

r2 


|^  + £(1-B)(2-B) 


rr~  4 D 

+ j-lU  + B)(2  - B>  + 


2(m  — 1) 
km 


E[aBB{X){  1 - B)(l  - B)MSB]  + o{m~') 


= (1-B)  + t(1-B)(2-B) 

+ hi[B + (1  + s)(2  ~ B) + 
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- 2(mkr^-E[aEB(X){l  -B)(  1 - B)MSB\ 

+ o(m_1).  (4-25) 

Combining  (4.23)  and  (4.25)  with  some  simplifications,  we  get 

m-'{i"E||X  - «CM||2  + (1  - W)E\\6CEB  - 0||2} 

= (1  - «)(1  - B)  + j [(1  - (1  - w)B)B-'(2  - B)] 

_2(m-  1)(1  „ _ _ B)aEBMSB} 

km 

+o(m~1).  (4-26) 


Next  we  find 


E[aEB(l  - B)MSB)  = £[(1  - B)2MSB2  + (1  - B)(M5S)(M5^)]1/2 


= £?[{(1  - h)\MSB )2  + (1  - ^)(M5B)(M5W")}1/2/[^=|]] 

+ M{(1  - ?)2(MSS)2  + (1  - ?)(M5B)(M5^)}1/2 

771  — 1 771  —1 


X/. 


(4.27) 


On  simplification, 


(1  - B)2(MSB )2  + (1  - B)(MSfl)(MSW) 


= [1  - (.m  ]2  (MSB)2  + [1  - 


(tti  - 1)M5S 
(MSB)2  - 


(tti  - 3)M,W 
(tti  — \)M  S B 


}(MSB)(MSW) 


+ 


+ (MSB)(MSW)- 


2 (tti  — 3)(MSW)(MSB)  t (m  — 3)2(MSW)2 
(m-l) 

771  — 3 , 


(t71  — l)2 


771—1 


(MSW) 


= (MSB)  — 


2 m 5(MS£)(MSW)  - ^(MSW)2 


771  — 1 


(tti  — l)2 


- g2(MSB,MSW)  (say), 


where  g(x,y)  = [x2  - ^xy  - j£#J/2]1/2  = (*  “ + ^l2/)1/2>  V < x- 
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By  Taylor  expansion,  for  y < x, 


g{x,  y)  = g{a2/B,a2) 

2 . . dg . , 2\  dg  i 

+ (x  — (T  /S)  — |x=0.2/b,j/=<t2  + (y  — G )~Q^\x=<T2/B,y=(T2 

+ \[(X  ~ P2/B)2^\x=a2/B,y=<r2  + (V  ~ ^ / B ,y=a2] 

B2n 

+ (x  - a2/B)(y  - a2)^|-|I=(rViW  + R(MSB , M5W).  (4.28) 
As  in  the  previous  chapters,  we  can  show  that 

E[\R(MSB,  MSW)\Is=k]]  < E[\R(MSB,  MSW) |]  = 0(rrT3/2).  (4.29) 


Also,  for  y < x, 


dg 


dx  g(x,y)  2(m  — 1) 

dg  1 

dy  2(m-l)g(x,y) 

d2g  1 


m — 1 


dx2  g(x,y)  g2{x,  y) 
1 


1 (m  — b)ysdg 

yx  o/'™  i\/o_i 


2 (m  — l)'5a;’ 


1 (I  _ j£ip% 


y(z,y)  53(^,2/)  2(m  — 1) 


\2„,2 


ay2 


g3(x,y) 
y 2 

4y3(z,y)’ 

l 

4 (m  — l)2 
4(m  — 3) 

1 

2(m  — 1) 

(m-  l)y(x,y) 

g2(x,y) 

1 

4 (m  — 3) 

1 

2(m  — 1) 

(m  - l)y(x,y) 

g3(x,y) 

1 

8(m  — 3)  + (m 

-sr  ,1 

X 

((m_5)z  + i<^)|£| 

m — l oy 

(m-5)x  + 4JaLl£k^ 

771—1 


s3(z,y) 


X 


4 g3(x,y)’ 
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d2g  _ 1 , m - 5 1 (m  - b)y  dg 

dxdy  g(x,  y)  2(m-l)'  g2{x,yy  2(m  - 1)' dy 

1 


2 (m  — 1) 

1 

4(m  — l)2 
xy 


m - 5 . (m  — 5)yw,  . 4(m  - 3)y).  3 . 

-7 7 + (*  - ^7 Jr  m - 5)x  + f1)  g3(x,y) 

g{x,y)  2(m  — 1)  m - 1 

-2(m  — 5)2  — 8(m  — 3)  + (m  — 5)2 


g3{x,y) 


-xy 


4g3(x,y) 

Hence,  by  (4.28),  (4.29)  and  (4.30), 


(4.30) 


E\g{x,y)\  = g(a2/B,  a2) 

1 

2 


■ (x-o*/B)*o*  + (y  - <^)V_  _^x-  a2/B){y  - a2)a4 


4g3 (a2 / B , a2)  4g3(a2  / B,a2)B2  4g3(a2/B,  a2)B 

+ 0{m-3'2) 


= g{°  /B,a2)  - 
+ 0(m~3/2) 

= g{o2/B,a2)- 
+ 0(m~3/2) 

= g{a<2  / B,  (t2)  — 

+ 0{m~3/2) 


8g3(a2/B,a2)  . 


8 g3{a2/B,a2) 


E(x-^/Bf  + 4-E(y-^f 


2 a4 


( m — 4)B2 


+ 2a4m(k  — 1 )B* 


. a 8 ..  mk  — 1 . 

4 g3 (cr2 / B , a2) B2  m(m  — l)(k  — l) 


(4.31) 


and  so, 


gW)  . + 


cr2(- — — + _1_)1/2(I  + _L_)i/a 
V £ m-r  KB  m- V 


= a2{\  -B)1/2B~1(1  + 


2 B 


(m-  1)(1  - B) 


)1/2(!  + ^)1/2 


m — l' 


(4.32) 
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Combining  (4.31)  and  (4.32), 


*«*■*)]  = 

- M0^0Wa~Hl-Br3l2B3+O{m^ 


= (1  -Bf^B-'a2 


4(fe  — 1) 


] + o(m  *) 


= h(a2  / B,  a2),  (say). 


(4.33) 


Now 

E[g(MSB,MSW)I{^  = E(h(o2/B,o2)I[ii=^  + 0(m-2l2) 

= h(a2/B , <r2)[l  - P(B  ^ k)]  + 0(m~3/ 2) 

= %2/5^2)  + 0(m-3/2).  (4.34) 


Finally,  it  is  easy  to  check  that 

£|{(1  _ ^5i)3(msb)2  + - ^)<MS-B)(MSiy)}1/2/[ii^]] 

< /i1,J[{(]  - + (1  - ----■  )(MSB){MSW)},'n\I>ir‘(B  y B) 

m — 1 m — 1 

< [£{(MSP)2  + (M55)(M5kF)}]1/2P1/2(S  ± &) 

— o(m~r),  (4.35) 

for  and  arbitrary  r > 0.  Combining  (4.26)  with  (4.33),  (4.34)  and  (4.35),  the  proof 
is  completed. 


CHAPTER  5 

CONCLUSION  & FUTURE  STUDY 
5.1  Conclusion 

One  of  the  main  objectives  of  this  dissertation  is  to  obtain  the  constrained 
Bayes  and  empirical  Bayes  estimators,  and  also  as  measures  of  precision,  the 
asymptotic  mean  squared  errors  (MSE’s)  of  these  estimators  which  are  correct  up 
to  a certain  order.  In  addition,  constrained  Bayes  and  empirical  Bayes  estimators 
and  their  Bayes  risks  are  found  under  both  squared  error  loss  and  balanced  loss 
functions.  The  asymptotic  Bayes  risks  are  calculated,  and  asymptotically  unbiased 
estimators  of  these  Bayes  risks  are  obtained. 

In  Chapter  2,  we  considered  the  asymptotic  expansion  of  the  MSE  of  con- 
strained James-Stein  estimators.  This  expansion  is  valid  up  to  0(m_1),  where  m 
denotes  the  sample  size.  We  also  provided  an  estimator  of  the  MSE  asymptot- 
ically valid  up  to  0(m_1).  A simulation  study  was  undertaken  to  evaluate  the 
performance  of  these  estimators. 

Chapter  3 developed  constrained  Bayes  and  empirical  Bayes  estimators 
under  balanced  loss  functions.  In  particular,  such  estimators  were  derived  under 
the  one-parameter  exponential  family  of  distributions.  In  the  normal-normal 
example,  asymptotic  expansions  of  MSE’s  of  the  Bayes  and  empirical  Bayes 
estimators  were  provided  which  were  asymptotically  valid  up  to  0(m-1).  In 
addition,  similar  asymptotic  expansions  of  MSE’s  of  constrained  Bayes  and 
empirical  Bayes  estimators  were  also  provided.  Estimators  of  these  MSE’s  in  the 
spirit  of  Chapter  2 were  given. 

Chapter  4 developed  constrained  Bayes  and  constrained  empirical  Bayes 
estimators  for  the  random  effects  balanced  normal  ANOVA  model  when  both 
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variance  components  were  unknown.  The  asymptotic  MSE’s  valid  up  to  0(m-1) 
were  derived  as  in  the  previous  chapters. 

5.2  Future  Study 

This  dissertation  is  devoted  exclusively  to  balanced  data,  that  is  when  the 
number  of  observations  per  cell  is  the  same.  We  want  to  continue  this  research  for 
unbalanced  data,  i.e.,  with  varying  number  of  observations  in  the  different  cells. 

We  also  want  to  extend  our  findings  for  cross-classificatory  models  with  or  without 
interaction,  and  develop  similar  constrained  Bayes  and  empirical  Bayes  estimators 
both  under  squared  error  and  balanced  loss  functions. 
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